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War is the scientific answer to the question: Should a pupil memo- 
rize by the whole method or by the part method ? 

Since the initial experimental attack upon this problem by Steffens 
in 1900.1 a considerable body of experimental data has accumulated 
the results of some thirty odd investigations. The problem is recognized 
as one of far reaching pedagogical importance as well as one of theoretical! 
significance. It is, therefore, important to inquire what conclusions are 
justified by these widely different experimental attacks, and whether or 
not contemporary textbook treatments of the problem are in accord with 
the facts. 

It should be stated here that the discussion in this paper will not 
eover acts of skill but will be limited to the field of memorizing, since the 
primary interest of the educator is in meaningful materials. The main 
contentions and conclusions of this paper, however, are equally true in 
the field of motor learning. 

An analysis of seven well-known and widely used texts in educational 
psychology, which have been published within the last five years, gave 
the following results: In one text,? the problem is not discussed; in 
another,’ the author concluded that ‘‘of the eleven or twelve reported 
experiments, about four favor the part method, and the rest, the whole 
method.’ but, because of the inconsistency of results, advised that each 
individual ‘*‘ find out as soon as possible by the experimental method what 


is the most efficient method for him;’’ in the remaining five texts it is 


‘Steffens, L. ‘‘Experimentelle Beitrage zur Lehre vom ékonomischen Lernen,’’ 
Zeitschrift fi Psychologe, 1900, XXII, 321-382. 

>Trow, W. C. Educational Psychoiogy. New York: Houghton Mifflin Co., 1951. 

* Jordan, A. M. Educational Psychology. New York: Henry Holt and Co., 
1928), p. 175. 
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explhicits stated. as the following quotations indieate, that the whol 
method is superior to the part in both learning and retention: 

‘Experiments show that—the ‘whole’ method, 1s more economical! 
than ‘learning by parts,’ although part learning ts the method more con 
monly employed in school,’™ 

‘The general answer from experimental work on this problem is tl 
the whole method is better than the part method, other things ben 
equal,”’ 

‘Poetry or prose can, as a rule, be memorized more quickly if tl 
material is read through as a whole from beginning to end than if 
‘< memorized in small sections of two or three lines; and what is moi 
important, when this method is employed, the retention is more pe! 
manent.’ 

‘“The whole method shows to advantage in memorizing poetry, pros 
vocabularies. lists of words and nonsense syllables—and probably in most 
materials which are to be memorized in serial order.’” 

‘the experimental evidence shows clearly that for the majorit) 
of individuals the method of learning by wholes is much superior.’ 

‘ things which are to be learned in serial order are best learne« 
by wholes, provided, of course, that the wholes are not unreasonably) 
great. And when learned by wholes they are remembered for a longer 
time than if they had been learned by parts.’”® 

These five authors, moreover, have no difficulty in presenting reasons 
for, and explanations of, the superiority of the whole method. 

This tendency to accept a superiority of the whole method is her 
called in question. Tn a recent critical review of the experimental litera 
ture. the investigations have been classified on the basis of types of 
learning materials used. In the twenty-two experiments on memorizing, 
the following, which varied in length, natwre and difficulty, were used as 
learnine materials: poetry, prose, paired associates or vocabularies and 

‘Sandiford. P. Educational Psychology. (New York: Longmans Green and Co., 
1929), p. 225. 

®Pintner, R. Educational Psychology: An Introductory Text. (New York 


Henry Holt and Co., 1929), p. 237. 

Starch. D. Educational Psychology. (revised edition) (New York: Maemillan 
Company, 1927), p. 201 

‘Gates. A. I. Psychology for Students of Education. (revised edition) (New 
York: Macmillan Company, 1930), p. 334. 

*Cameron, E. H. Educational Psychology. (New York: Century Company, 
1927), p. 258. 

*Sandiford, P. op. cit. p. 227. 

® McGeoch. G. O. ‘‘Whole-Part Problem,’’ Psychological Bulletin, XXVIII, 
1931), 713-739. 
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f nonsense syllables and of words. Furthermore, the investigations 
widely in experimental conditions and techniques employed: in 
er. age. training and ability of subjects; in amount, distribution 
iture of practice periods ; in methods of measuring learning and 
tion efficiency; in length of interval after whieh retention was 
+-fed: and in the forms of the part method used. In only five of thes 
two investigations, did the number of subjects used and the 
sion of experimental technique yield results amenable to statistical 

t ment. The results of these experiments are as follows: 

Warner Brown” found the whole method reliably superior to the part 
ree out of his four groups of adult subjects who learned lists of 12 
sh-nonsense syllable pairs. 

\ progressive part method was found by Winch” to be superior to 
chole with children from 1114 to 13 years old in the learning of 
rt?’ poems, but there was no reliable difference between the two 
“ls in the retention of some of these poems. 

Ht. B. Reed! found ho reliable differences between the average seores 

the whole, progressive part and part methods in the learning of tour 

as by adult subjects, and concluded that the efficiency of learning 
ods is a funetion of the individual learners, 77 percent of whom 
ind a part method more economical. 

Georgiana Wylie™ found the whole method superior to the part with 
serial learning of lists of from 8 to 24 items with the majority of her 
it subjects. This advantage of the whole increased with practice 
There were no decisive differences, however, between the two methods 

retention after an interval of 24 hours. 

rhe writer™ found no reliable differences between the whole, pro 

ssive part and pure part methods with 9 and 10 year old ehildren 

the learning or retention of 12 lines of poetry. With the same sub 
jects, however, she found a reliable superiority of the whole method 
over the pure part in the learning and retention of vocabulary material, 


Brown. Warner. ‘‘ Whole and Part Methods in Learning,’’ Journal of Educa 
tional Psychology, XV, (1924), 229-233. 
2 Winch. W. H. ‘‘Should Poems be Learnt by School Children as ‘Wholes’ or 
‘Parts’?’’ British Journal of Psychology, XV (1924), 64-79. 
Reed, H. B. ‘‘ Part and Whole Methods of Learning,’’ Journal of Educational 
Psychology, XV (1924), 107-115. 
‘ W vlie, Georgiana E. ‘*Whole versus Part Methods of Learning as Dependent 
Practice,’’ Doctoral Dissertation, 1928, on file in the library of the University 
f Chieago. 
“ MeGeoch, G. O. ‘‘The Intelligence Quotient as a Factor in the Whole-Part 
Problem,’’ Journal of Experimental Psychology, XIV 1931), 333-358. 


7 
fi 
ae 
> 
ri 
n 
J 
t 
? 
¢ 
el: 
d 
¢ 
- 
} 


{ JOURNAL OF EDUCATIONAL RESEARCH [ Vol. 26, Ne 
t 
lists of 10 Turkish-English pairs and lists of 10 nonsense syllable—Eng { 
lish pairs. In learning, this advantage of the whole method was relative 
as well as absolute ly vreater with the gifted vroup (mean 1.4). 151) tha bo 
with the normal group (mean 1.Q. 99). There were, however, no cor ’ 
sistent differences between the whole and Progressive part or bet wee 
the progressive part and pure part methods, P 

In a recent investigation the writer found no reliable differences bx ‘ 
tween the whole and pure part methods in the learning or retention o . 
12 lines of poetry by third and fourth grade school children, and in ai 

other experiment with children of the same age who learned 24 lines of # 
a poetry, no reliable differenee between the two spontaneous and habitu: , 
methods, learning lines’’ and learning ** by verses.’’ 
ae. On the basis of such a variety of results, all of which are statisticall 
be reliable, which method, can we conclude, is superior? Should we inter- ¢ 
3 1 pret this disagreement as an indication of defects in the experiment 
ta } technique of those investigators who failed to establish the superiorit A 
a of the whole method?) Such questions imply that there is a method of — , 
learning which is really or inherently superior, and that e rtain experi 
mental conditions permit this superiority to show itself, while other con ’ 
ditions mask or hide this intrinsie superiority. MeGeoch™ has ealled + 
attention to the fact that such a point of view is contrary to the logie of ; 
science. No phenomenon known to science is unconditioned: an abso 
lutely best method of learning has no emp trieal existence. The scientific 
voal, and likewise the goal of the edueator, is (o discover by experimenta ; 
tion all the possible factors of which the efficiency of any given learning 
method is a funetion. The question is not: Is the whole method superior * 
to the part method? The question is: Under what conditions is the f 
whole method superior to the part method? 

The writer's’ analysis of the experimental data has suggested that 7 
the relative efficiency of the whole and part methods is a function of, at | 
least, the following factors: 

[. Forms of the part method used: whether pure part, progressiv: { 

part, irregular part, ete. ’ 

II. Methods of measuring learning efficiency: whether work limit ot 

time limit eriterion, whether forward or reverse association is : 

“MeGeoch. J. A. “The Acquisition of Skill,’’ Psychological Bulletin, XXVIII 
193 n. 418 
1931), 713-739. 
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with paired associates, whether poetry is seored on the 
hasis of correct words, lines or thought, ete 

i, Subjects: their age, memorizing ability, practice in the use of the 
learning methods used and their intelligence. 

\. Material: type, difficulty, nature and length 

\. Practice: whether massed or distributed practice, total amount 
of practice and nature of practice yy riods. 

| Methods of measuring retention efficiency: whether in terms of 
recall score, saving score, or a composite, learning-plus relearning, 


seore., 


(1. Length of the interval after which retention is tested. 


At the present time, however, the experimental data do not justify 
veneralization regarding the differential and reciprocal effects of 
.e factors, while the specific effect of only two factors, practice and 
lligence. have been demonstrated by Wylie” and the writer,’’ re 
tively. within the narrow limits of their « xperimental conditions 


Practieally speaking, the present scientific data do not justify the 


ommendation of any particular learning method for classroom Use, 


re is no selientifie answer to the question : should a pupil memorize 
the whole method or by the part? 
‘Wvlie, Georgiana E. op. ett 


“MeGeoch, G. O. ‘*The Intelligence Quotient as a Factor 1 the 
lem.’’ Jo nal of Experimental Psychology, X1V 1931), 333-308. 
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LONG DIVISION VERSUS SHORT DIVISION ; 


HERBERT T. OLANDER 
University of %tlsburah 


and 

E. PRESTON SHARP 
Joh town, Pen anta 


lo what extent do pupils use short division in examples with singl 


digit divisors ? What are some of the faetors which influence the selec ‘ 


tion of the method used? Which method ts selected by brighter pupils Z 
Is long division used with greater accuracy than short division? 

The customary order of proceedure in teaching division of number: ? 
to elementary school pupils is to teach a child first to know a specifi: 
number of simple division combinations; secondly, to work example 
with single-digit divisors and with varying numbers of digits in th 
dividend by a short division method; and, thirdly, to divide numbers, 
containing divisors with two or more digits by a long division process 
In short division the pupil mentally carries out the steps in the process, ° 
writing only the answer; in long division the child places each step o1 
his caleulations on paper. 

Several writers have contended, and some evidence has been produced 
to prove,’ that long division should precede short division and that the 
latter should be taught as a short-cut to the former. The evidence and 
arguments center largely in the problem of the order of introducing the 
two processes. Few individuals seem to have considered the question . 
whether we should continue our present insistence on pupils’ using the 
short division method with single-digit divisors. If we knew to what 
extent pupils throughout the different grades regularly use the short | S 
method under the condition preseribed and also the comparative accu 
racy with which the short and long processes are employed, we might 
even see reasons for contending that our present stress on short division , 


is not worthwhile. By thus abandoning our insistence on short division, 
we could eliminate a field of considerable worry for the elementary school 
teacher With the purpose in mind, therefore, of dete rmining the extent 
to which and also the accuracy with which pupils throughout the grades 
use the short division method with single digit divisors, the present study 
was undertaken 

‘See especially Lenore John ‘The Effect of Using the Long-Division Form in 
Teaching Division by One-Digit Numbers’’ in The Elementary School Journal for 


May, 1930, pp. 675-692; and also R. L. Morton, Teaching Arithmetic in the Primary t 


Grades. Silver, Burdett and Company, pp. 167-169. 
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rhe subjects engaging in this investigation consisted of 1265 pupils 
~ grades LV to XII inclusive from four different school systems Of 
se. 1083 were in the elementary grades from grades IV through VIII; 
“emaining 182 were in the high-school grades from IX through XII. 
fhe pupils in all grades were given the same division test containing 
en difficult examples, five of which had one-digit divisors and two of 
em two-digit divisors. Two forms of this test were constructed. In 
the two examples containing two-digit divisors appeared as the 
+ and fourth among the seven examples in the test; in the other form, 
appeared as the second and fourth. The reason for this variation 
the order was to take into account the effect of a possible ‘*mind-set,’’ 
er for long or short division produced by the particular one of the 
} types which was placed first i the test. As it happened, the re- 
ts showed no tendeney that could be attributed to the order of appear 
of the two types ot examples in the test. No mention of short or 
v@ division was made to the pupils during the administration of this 
st. Thus, a measure of the pupils’ tendency to use either long or short 
vision in the ease of single-digit divisors was obtained. 
Besides this test, another was administered consisting of ten division 
mples with single-digit divisors. Five of the examples the pupils 
vere requested to work by short division, the other five by long division. 
wo forms of this test were made. In the one form the pupils were asked 
work the first five examples by the short division process and the see 
nd five by long division; in the second form these directions were re 
ersed. Thus each group of examples was worked both by long and 
ort division. Part of the pupils took the one form of the test; part 
took the other. By means of this arrangement, the pupils’ scores at- 
tained by use of the two methods were comparable. The purpose of this 
est was to seek a measure of the comparative accuracy with which pupils 
ork single-digit examples by short and long division. 
The teachers of the children in the investigation administered the 
tests by following carefully worded instructions. The teachers were told 
at the tests were not designed with a view to comparing the achieve 
ments of the pupils involved but merely with the purpose ol getting data 
n the comparative effectiveness with which pupils work by the long and 
short division methods. 
Table I presents the numbers and percentages of pupils who worked 
the five division examples containing one-digit divisors by long division 
exclusively, those using short division exclusively, and those who worked 
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some examples by the long and some by the short Process It will b 
noted that in grade IV there were 147 pupils who worked by the long 
method, 33 who worked by the short method, and four who used bot! 
methods. Interpreted in percentages, 80 percent of the pupils in grad 
IV worked by long division, 18 pereent by short division, and two percent 
partly by one and partly by the other method. Similar data are given 
for the remaining grades. The figures for all grades combined show 
that three out of four pupils use the long division method with examples 
containing one-digit divisors, one out of five use short division, while 
one out of twenty use both methods. Little difference between the elemen 
tars and high-school grades is to be noted. Short division had bee 
stressed in grade III which fact would lead one to anticipate a larger 
percentage of use of this method in grade IV. No such observation is 
to be made, however. Grades V and IX show marked variation but the 
significance of these variations Is minimized by the fact that they car 
be accounted for by no reason other than that such a large percentage ol 
the pupils comprising these two grades happened to be located in grade 
rooms in which apparently unusual efforts had been made by the teach 
ers in requiring the pupils to work all examples with single-digit divisors 
by the short method Murther comments upon this point will be mack 
in a later paragraph of this article. 

Not only was it of interest to know what percentages of pupils elected 
to work examples with single-digit divisors by the long division method 


but also to determine the accuracy with which pupils use each of the two 


TABLE I 


ND PERCENTAGE OF PUPILS WORKING Suot DIVISION EXAMPLES BY 
ION Exe I Y, BY Sport Division EXxcivsi AND PART OF THI 
EXAMPLI BY ONE AND PART BY iz O M ) 

retal N 
I) ~ t Div Bot) Met f 
14 is 184 
t 188 1 a2 
) . 12 16 17 ‘ 268 
141 7 15 13 7 181 
is 9 15 61 
1! i 6 13 
1 24 6 18 3 
R24 if 211 0 is 108 
HS 40 7 182 
I ‘ 1 


methods. This information is presented in Table II. As noted at the 


outset of this discussion. the pupils were reque sted first to work five ex- 
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des long division shows the greater accuracy Ih; 
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« by one method and then five additional examples by the other 
od. method and sets of examples being rotated to eliminate the 
bles which otherwise would have heen pres nt Aceording to lable 


vrade IV there were | examples correct long division or 63 


ent of the examples attempted by 184 pupils, whereas when short 


sion Was employed, examples were correct or 57 percent of all 


npted In the total figures both tor the ele mentary and high-school 


it} 


‘he totals for all grades 


te SO pe reent accuracy tor long division and a corresponding 75 


ent for short division The facts appear to show not only that pupils 

er to work one-digit examples by long division but that they use this 

ess with single-digit numbers with greater accuracy. 

Phat the preponderant preference for long division characterizes the 
student as well as the average and poor one is borne out by th 
in Table IIT. In this table appear the numbers and pereentages of 


ils using long division, short division, or hoth methods among those 


As in Table II, this table reveals 


» wot all of their « xamples eorrect. 
Though the use 


t the ratio of long to short division is almost 3 to 1. 
combination of both methods among th: good students parallels very 
v that observed in Table IT for all students, there is a noticeably 
ter preterence for short division among the good students inasmuch 


TABLE II 


ATTN ACCURACY WITH Wuicu PuPpILs WorKED LONG DIVISION AND Si I 
DIVISION EXAMPLES WHEN THEY WERE REQU! » Tro Use Fu 

rHE ONE Metrnop AND Tile? 

184 20 68 181 61 108 18 L2¢ 
} 

eo by 

) 7 71 74 8 7 


TABLE 


MBER AND PERCENTAGES OF PupILS AMONG THOSE HAVING ALL EXAMPLES CORRECT 
WorKED By Long Division EXCLUSIVELY, BY Divisio? 
EXCLUSIVELY. AND THOSE WHO WorKED PART OF THE EXAMPLI 


By ONE AND PART BY THE OrHerR METHOD 


les 


> 
x 
= 
, 
‘ 
a 4 
NUMB 
Pupils Percent Pupils Pereent ipils Percent 
Division 277 70 46 64 
t Division 25 >] 119 
Both Methods 20 
7 
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as approximately 5 percent more of the good students used short division 
This appears to hold true both for elementary and high school student 

The strongest factor associated with the use of short or long divisio 
appeared to be that of the teacher. In one school building the fourt! 
vrade pupils worked the examples with single-digit divisors exelusivel, 
by long division, the fifth-grade used short division almost without ex 
ception, whereas the sixth-grade used long division. In one schoo 
system In school buildings closely adjacent, a fourth grade emploves 
short division almost entirely while another fourth-grade used long divi 
sion llowever. no consistent greater accura ‘\ in such eases could by 
found favoring either method. In Table LV, below, appear the averag 
scores per pupil, based on the five division examples with single-division 
divisors, of two fourth-grade rooms, in one of which short division pri 


dominated and in the other long division. In addition to this, the score: 


TABLE IV 
COMPARATIVE AVERAGE Scores OF PUPILS IN ROOMS IN WHICH SuHorT Division Wa 
rHE PREDOMINANT Meruop EMPLOYED ANP IN ROOMS IN WHICH LONG 
DIVISION WAS THE PREDOMINANT METHOD EMPLOYED 


No. Students Average Sx 

} 

Root ACS 

Ro Bol +4 3.6 
I h Grad 

Rooms C an 76 

Remaining Rooms 154 +1 
S refers to rooms in which short division was predominant 

refers to rooms in which long division was predominant 


of two groups of fifth-grade rooms are included, one composed of tw 
rooms using mainly short division and one composed of the remaining 
fifth-grade rooms which employed mainly long division. It will be noted 
that though the pupils using long division in the fourth-grade had a 
advantage of almost one example out of five, a similar advantage favored 
the short division group in the fifth grade. These facts in all likelihood 
mean that a faetor, which in this case outweighs the effect of the par 
ticular method used, is the efficiency of the teaching in the classrooms 
concerned. The pupils who were best taught achieved the higher scores 
regardless of the method used. Another explanation may be the varying 


capacities of the groups of children concerned. 


CONCLUSIONS 
The conclusions which may be drawn from the results of this investi 


gation are as follows: 
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1) Three out of four pupils from grades LV to XII, inclusive, chose 

vork difficult examples in division with single-digit divisors by long 

' sion: one out of five elected short division, whereas one out of twenty 
se to work partly by long and partly by short division. 

») Little difference in choice of method could be attributed to the 
ie in school to which a ehild belonged. Lligh school pupils varied 
tle from those in the elementary school. Even pupils in the fourth 
de. notwithstanding their recent intensive experience with short divi 

in the third grade, predominantly used the long division method. 

3) A slightly stronger tendency toward short division on the part 
vood students both in the elementary and high-school grades was 
served, 

$) Pupils used the long division method with greater accuracy. 


hen they were requested to work examples containing single-digit divi 


rs by short division and other examples by long division the averag 
iracy for long division was 80 percent and that for short division 75 
cent. 

5) The greatest factor determining the choice of method seemed to 
that of the teacher and teaching method. In two school systems short 
sion was markedly more used than in two others. In the same school 

stem one classroom of a given grade used long division almost exelu 
ely while another classroom of the same grade used short division 


most exclusively. 


EDUCATIONAL IMPLICATIONS 
Since three out of four pupils in school prefer long to short division in 
orking diffieult examples with single-digit divisors and, again, since 
‘ ipils are more accurate with the long than the short form, it seems 
ivisable that teachers should not only teach long division first but teach 
as the regular method that will be used by the majority of the pupils 
Short division ean then be taught as a short-cut to be used particularly 
th comparatively easy examples. Especially the better pupils may be 


lvised to employ the short method. 
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a rYPES OF ERRORS AND REMEDIAL WORK IN THE 


= FUNDAMENTAL PROCESSES OF ALGEBRA 


Tuts Investigation was condueted to supplement in an explhieit ana 


et tangible manner the analy ses of the speentic errors which are most fre 
: «pte nth made in the fundamental processes of algebra The study Was 

a confined to the difficulties of the ninth gerade. The data were collected 5 
ae from 104 ninth-grade pupils in the East High School, Superior, Wis 
. eonsin With the exception of one ha whose | () wis only 65, the 
intelligence quotients of these pupils ranged from 72 te 154. There wer 

= . from 79 to 104 papers tor each test, ce yr nding upon the daily attend R 
ance Sinee this investigation Was conducted in reeular classes, all the 


usual difficulties and inadequacies of classroom investigations were en 
countered The resulis are, thereiore, only indicative of what eould 
discovered or produced controlled expermmentation This report cle 
seribes such activities as unis elassroom teacher can conduct. 
These pupils were from five cits ward schools, two parochial schools 
and from outlying country schools, and ranged in age from twelve years 
to sixteen vVears The results of the Otis Self-Administering Tests 
Form A, were used as the basis of grouping Due to conflicts in in 
dividual programs some shifting had to be done, and, as shown in Tabls 
I. the resulting groups were fairly heterogeneous. Later in the year 
uniter the algebrale ability of individuals had heen discovered, pupils 
were shifted, as far as their schedules would permit, mto homogeneous 


Yroups 


rABLE I 
CLASSIFICATION OF GROUPS 
Avera Range of 
I. Q I. Q 
‘ 11 1 134 
‘ 41 to 114 
87.7 65 t 


During the first semester, one pupil failed beeause of lack of effort. 
one transt rred to another school, and one dropped because of illness 
Betore the close of the second semester, SIX pupils, all ot whom were 


from the D group, dropped out of school. 
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ise of signs. 


ised in arithmetic it suggested take 


tracted 
two errors were made when the plus and minus signs occurred together, 


ERRORS AND REMEDIAL WORK IN ALGEBRA 13 


The errors of eaen pupil on the first test were noted, and only Ost 
s who attained less than 90 percent were given additional dmll worl 
he tvpe of perrormahce missed and another test This proeedur 
until the pupil reached the limit of his ability There 


continued 
‘+k of ability prevented high-grads 


pupils these vroups w hose 


ormance \ study was made of 179 problems in the four funda 
i] processes in the solution of which 1512 pupil errors wer isolated 

timed tests were given on each principle involved, and the diag 
s of errors was made from these test papers. Each paper was studied 


eate the characteristics of each pupil's errors. 
Errors in addition A study of tests in the addition of algebraic quan 
es indieates that the most frequent errors occurred in the use of coeffi 
97, or 27.9 percent, were coefticient 


ts Mut of a total of 347 errors, 
arithmetical 


Many ot 


vue either 


S These errors are so close ly relate al to those made 1? 


jinations that thes properly may be analyzed togethe 


errors in the addition of monomials and polynomials were d 


e carrving of one too many or to failing to earry in the at ithmetical 
cesses These errors suggested that the sign and the arithmetical 
ihinations were not sufficiently automatic to allow the pupil's entire 
tention to be centered on what was new in algebra Thirty three other 
ors in addition were due to confusion which may have resulted from 
vertical columns in addition of polynomials were al 


fact that the 
Arrang 


nged illogieally or were not placed directly under each other. 
quantities in proper columns with their correct signs, combining the 


sitive and negative numbers as -they oceur, or adding the positive and 
en the negative numbers and combining th result by means of sub 
ction in order to get the correct result is a complex problem for by 
nners in algebra. An algebraie quantity without a coefficient of more 
n one was invariably counted as 0. This error persisted after much 


Il. 
( irelessness in riting was anothe r soures ot trouble: eareless writ 
vy of 10 eaused it to be read as 76, and z was read 2 and @ was some 


mes taken tor 9 The next largest numbet of errors appeared nm the 


These errors were due principally to the consistent poles 
a tew pupils to find the result and prefix the sign of the top number. 


process itself the greatest difficulty was with the minus sign. As 
the pupils sub 


the 
away twig and SO 


Thirty of the process errors were due to this confusion, Twenty 


Regus! 
> 
j 
‘ 
th 
| 
oT 
| 
“oe 


4 


= 


q 7 

at 


14 JOURNAL OF EDUCATIONAL RESEARCH [ Vol. 26, No. 


in which ease the sign of the top number was prefixed, and, as the prob 
lems were in addition, the sum was found. Errors were made in copy 
ing the problems from the board, especially in copying a polynomia 
which had to be arranged in a logieal order as it was copied. For ex 
ample, a distinetion between a and a® was not always made. Anothe 
difficulty was in keeping the terms and the signs directly under each othe 

Errors in subtraction.—Sigus gave the greatest trouble in subtraction 
Phere was evidence that some pupils thought the result should always 
be negative, probably because the problems were in subtraction. The 
method used in teaching this process was the addition method, ‘‘ What 
should you add to the subtrahend to get the minuend?’’ Other trouble 


. —15 —15 . 
me combinations were and - the results given were 
sf { 8 : 12 
7, + 23, and +21. The word ‘‘add’’ in the directions probably ac- 


counts for this. In the removal of parentheses the greatest number of 
errors appeared in the failure to change the sign of the last term in the 
parentheses. Another difficulty was with the larger subtrahend like 

= and ii the results given being + 38 and — 21. It was evi- 
dently easy to perform the operations indieated by the signs in the 
removal of parentheses, but it was a puzzle to know when to add and 
when to subtract if the numbers were placed under each other with plus 
and minus signs. Since subtraction is little used except when paren- 
theses occur, these errors were not considered seriously. 

Errors in multiplication.—In the multiplication of algebraic quanti- 
ties the problems become more complex for the child, and the analysis 
of the errors also becomes more complicated. In the problem 7x — 3 

tx 7), the prevailing error was in multiplying by 77 as well as by 3 
Out of 66 errors 42 were due to this misunderstanding. Multiplying the 
first term only was next in prevalence, and removing the parenthesis and 
combining as in addition was another type ef error. Signs gave troubl 
in the removal of parentheses. In the problem — 2a (3a +4a — 6) the 
common error was the removal of the parentheses and a change of sign 
as if a minus sign preeeded the parenthesis; no multiplication was 
performed. The problem evidently was understood as a subtraction 
problem. 

In the multiplication of polynomials an interference seemed to aris 
from the law of signs. Since like signs in multiplication give a positive 


produet, these problems being in multiplication, the like signs gave a 
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ve result when the partial products were added, and likewise the 
of the unlike signs gave a negative result. Inserting an extra term 
tting a term eaused a few of the errors in multipheation. Thess 
red most frequently in the horizontal multiplications, as did also 


wflicient errors. The question whether or not these were arithmetical 


vebraieal errors was frequently diffieult to determine. As examples, 
x 2 2x? ox and (a + 6 
al 
e represent some typical results given. It is evident that 72 represents an 


metieal trouble and that 3 was the result of the wrong process, pre 
bly because the plus sign before the 3 suggested addition. The 
rs made in the exponents occurred mostly in the addition of the partial 
its. It appears that the law of exponents learned for multiplica 


acted as an interference when the adding of the partial products 


required. Since the problems involved -were multiplication prob 
s the exponents were added as follows when the partial products were 
ined: 
ox + — 
ma 
+ Sx* Ox 
ox? + 4x 3 
It was sometimes difficult also to determine whether the wrong coeffi 


was an arithmetical or an algebraic error. It might have been either 
result of the combination of the wrong terms or a lack of facility with 
number combinations. 
Errors in division.—The analysis of the errors in division presented 
it as complicated a problem as did the analysis of those in multi- 
‘ plication. Sinee many of the fundamental processes were involved here, 
rs already analyzed in the preceding pages were found in the divi 


sion of monomials and polynomials. 


TABLE II 


DISTRIBUTION OF ErRoRS AMONG THE Four FUNDAMENTAL PROCESSES 


Number of Percent of Number of Percent of 
Problems Prohlems Errors Errors 
. 147 26.5 
or i756 : 24.4 225 17.1 
atior 1614 . ; 22.4 519 19.6 
739 10.9 221 16.8 


Total 7197 100.0 1312 1¢ 
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Dist hution of errors Tables I] to Vi show the distribution of t 
errors among the four fundame ital processes, among the different types 
of errors. and among the four abilitv groups ‘ 
rABLE Ill 
1) Errors MADE IN THE Fo FUNDAMENTAL PROCESSES 
ik Four DIFFFREN ABILITY GRrovUuPs 
P f 
rotal N No. 
i 11 l 16.1 2 2 
312 l 
TABLE I\ 
rue Comet I MADE IN PROBLEMS GIvt I I 1k YEAR TO 
1) ‘ Dirt PERSI AND EXT! 
$133 
rABLE \ 
rue or Types OF PERSISTENT ERRORS 
Mult ‘ 16 $5.6 per nt 
64 4.2 3 t Ip 13 85.7 percent 
43 or 11 percent 
>) at 1 percent 
Divis 108 4 percent 
4 4 reent su pe ent 
Hu pe ent 
M at 69 16 percent 
M ‘ > 7 percent 
Fr th Exy ents. 73 or 8.9 percent a 18 or 24.6 percent 
\ lit ' 
Sit or 18.4 percent 
I r 6 | ent Multiy ation 13 or 25 percent 
Subtractio ’ 17.4 percent 


Multiplication and division evidently presented the greatest numbe 
of diffieulties. Analyses of the individual papers indicated difficulties 
with the laws of signs and of exponents in multiplication and division 
When both signs were negative, a positive sum or difference was given 
four pupils made 31 errors of this kind, and 154 sign errors were mace 
by 12 pupils, indicating that the difficulties were somewhat individual 
In the process itself eight pupils made 50 of the errors. 

Table VI indicates an inverse relationship between intelligence and 


errors in algebra. 
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TABLE VI 


STRIBUTION OF ERRORS IN THE Four FUNDAMENTAL PROCESSES AMONG TI 
Focr Apitity Groups (THESE ERRORS WER! FOUND IN 
Pre MS I SOL! IN ko ONS 
rotal N I f 
Gror Averag 1. Q 
11 13 54 
107.5 4 l 
98.1 1 7 1.79 
101 198 
per Puy 


Remedial work Need for remedial work often follows group teach 
Arousing the curiosity and interest ef pupils and securing their 

vtion, together with abundant drill, may reduce errors to a minimum, 

+ errors are likely to occur in the work of the most capable pupils The 
ollowed with these pupils was that of practice, test, further prac 
test, and so on to mastery. 

Ipon the basis of results of the tests the pupils were divided into see 


The sections which showed sufficient skill in the principle taught 


TABLE VII 
AppITIon Scores BEFORE AND AFTER REMEDIAL Work 
N of Pupils Score 
Group i! First Retest 
l 
7 17 
‘ be 
24 14 
TABLE VIII 
INDIVIDUAL SCORES ON THE SUCCESSIVI TES 
ot 1 Test II Test IIIT Group Pupil Test fest IT Test ITI 
100 16 
100 a6 al t 
96 1 l 
O68 1 6 
76 76 7 1 
92 l 6 
11 6 11 96 
Test I lest Test IIIT Group Pupil Test I Test If Test 
2 absent 76 
100 68 
100 1 72 “4 
96 
6 100 6 56 a4 
7 6 1 7 
11 72 8 11 60 
60 60 72 4 6 
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were assigned advanced problems in the use of that skill. The errors 
the other seetions were analyzed to find their causes. Drill was giv 
to fix the correct response. A second test was then given and the sar 
procedure followed. Pupils who showed inability to master the pri 
ciples after the second retesting were given individual attention, ar 
no further class time was used for their problems. 


Tables VIL and VIII show a few of the results of the foregoing pl: 


for remedial work with the four different ability groups. The scores 


represented in the tables were the result of one of the tests given 
addition. Table VII gives the number of pupils in each group, t! 


number who had a perfect seore, and the number retested in each grou 


Table VILL presents the scores made by the retested pupils in the differen: 


groups on the suceessive tests. 


Case studies The following samples of case reports deseribe son 


of the pupils who were in the greatest need of individual attention. Thes: 
pupils were little affected by the general remedial work given in class 


Many of them had personality complexes, and their first need was treat 
ment for their mental attitude. 


(‘ase I. Boy. I. (). 120. Group \. Slow but aceurate thinker. | 


pleasing personality, reserved, and appreciative. Marks o 
tests not indicative of his ability. Would think processes o1 
earefully but could not be hurried. Motor reactions slov 
His work nearly always perfect as far as he worked. Analyze 
his own errors and remained after school to make correetions 
Did not especially eare for algebra but ‘‘needed it to ent 
college."’ Work unfinished on timed tests. 

Frequently given twenty minutes drill for speed. Ap 
parently not much gain. 

Case Il. Boy. 15 years old. TI. Q. 103. Placed in the A group; late 
transferred to the D group. No apparent ability to general 
ize. Had to be retaught the principle with each new applica 
tion of it. Negative quantities always gave him trouble 
Memory poor, and he forgot the regular details for the head 
ing of his papers. Was willing and anxious to understan 
the work. Had too many extra-curricular activities. 

Had ‘‘no time’’ to come for special help. Arrived just 
in time for school in the morning; went home at the noor 
intermission; practiced with the orchestra after school. Mani 


fested a feeling of hurry which inereased toward the close 
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of school. Did the best he could under the cireumstances 
Given eredit for the vear’s work in algebra. Reeommended 
not to take geometry. 

Boy. Age 15 vears. I. Q. 152. Group A. Small for his ag 
and sensitive about it. (Brother two years younger is taller 
and much heavier.) Never ready to begin, a putterer. On 
timed tests the last to start and never completed a test. Day 
dreamer. Slow reader of problems and would speed up only 
under pressure. Knew arithmetical combinations. Signs used 
apparently haphazardly. Logical thinker im verbal problems. 
Oral recitation better than written. Given drill the 
mechanies of getting ready to start test. Required to have 
necessary tools ready when he came to class. Personally 
supervised to foree his attention and prevent waste of time 
when directions were given. Needed strong stimuli. Monthly 
grade of ‘*P’’ aroused him to the danger of failure and acted 
as a spur. 

Girl. Age 16. 1. Q. 98. Group C. Erratic worker. Might 
know the combinations one day and the next day indicate no 
knowledge of them. Errors made were difficult to analyze. 
In addition and subtraction of monomials would invariably 
prefix the sign 6f the top number. Did not sense the meaning 
of signed numbers. When asked to explain her results, had 
an excuse, such as, ‘‘Had a headache and couldn't think 
Developed ability slightly when working under direet super 
vision. 

Girl. Age 15. I. Q. 77. Group D. Only pupil to object to 
being placed in the D. group. Highest score made on ans 
test was 78 pereent. Would bring in problems correctly 
worked and could not **see’” why she did not get class assign 
ments correctly. Principles of algebra did not register. Made 
errors in copy. Failed to keep appointments for help. Ap 
parently made little improvement. Should repeat the seeond 
half of aigebra. 

Boy. 14 years old. 1. Q. 85. Group B. Made scores equal 
to the best in any group. Took pride in being the first to 
hand in contracts. Did contracts for ‘‘extra credit.’’ May 
have been spurred on by the poor record of his older brother 


with the same I. Q. 
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Case VII. Boy. 15 vears old. 1. Q. 65. Group D. Foreign parentag 
Changed spelling of his name when he entered junior hig 
school. Foreign language spoken at home. Seldom mac 
oral recitation. Yes’’ or ‘*No’’ answered to questions aske« 
Written papers neat; would often recopy them to make ther 
so. Aequired some skill in the mechanical processes. Was 
never sure about results. [If asked how he got a certain nun 
ber, he would immediately erase it. A strong bond betwee 
a question and an error. Very self-conscious at first. Coul 
not be induced to go to the board. Understood directions on] 
when put in simple, direet language. Made considerable gain 
Was allowed to try the second semester’s work. Was place 
with a low group ef fourteen pupils. Given much individual! 
attention. Scemed encouraged to try, by contact with a grou; 
that was having difficulties as numerous as his own. Haid 
serious difficulty with equations, because he did not sens 


x 3 


Made errors in copy. Exponents gave him the greatest trou 


their meaning; would write 


ble. All his work was done under direct supervision. N 
home work given him. Neatness of his papers was praised 
Great improvement shown in his personal traits. Willing) 
went to the board. Ceased to erase his work when asked t 
explain it. Volunteered to recite. Made effort to do assigned 
problems. Sueceeded with simple problems. Plan was t 
allow him a vear’s credit in general mathematies. He did 
not appear for the final examination. Reason not vet known 
case still pending. 

Summary and conclusions.—As a result of the foregoing analyses we 
find that the processes of multiplication and division presented the great 
est number of difficulties in proportion to the number of problems solved 
Even after remedial work and drill were given, difficulties in thes 
processes persisted. The well learned laws of signs and of exponents 
became an interference, especially in the combining of the partial products 
in multiplication. 

The greatest difficulty encountered in all the processes was in the use 
of signs. Of the 1312 errors isolated in the 7197 problems analyzed, 24.6 
percent were caused by the use of the wrong sign. As the pupils be 
eame more familiar with signs, this difficulty diminished, The errors 
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not confined, however, to the algebraic quantities. Combinations 
living arithmetical computations were not sufficiently automatic. Er 
‘1 coefficients are so closely related to the arithmetical process that 
may properly be classed with them. Arithmetical errors and errors 
oefficients furnished 10.6 percent and 11.2 percent, respectively, of 
the errors located. 

\lgebraie quantities with a coefficient of one invariably eaused troubl 

the addition and subtraction processes. A polynomial which had to 

rranged in logieal order as it was copied from the board also caused 

‘ble both in the arrangement of the quantities and in the distinction 

‘ween the different powers of any one letter. This difficulty disap 

red as the pupils beeame better acquainted with algebraic terms 
\cide from difficulties with signs, the next greatest trouble in subtraction 
was with problems whose subtrahends were larger than their minuends. 

unusualness of seeming to take a larger number from a smaller one 

ied trouble for many pupils at the beginning of the work. The use 

of the parenthesis in multiplication was evidently associated with its use 

subtraction and was thus the cause of errors in the removal ot 

rentheses in multiplication. There were more unfinished problems in 

ision in proportion to the number of problems solved than in any of 

e other fundamental processes. This was probably due to the compli- 
tions of the process itself. 

The average number of errors per pupil bears an inverse ratio to 
the average intelligence quotient of the group. Specialized drill reduced 
the diffieulties and aided in the assimilation and application of correct 
principles. As compared with other classes, the pupils in all groups 
acquired either an inereased ability in algebra or improved attitudes 


toward its problems, while pupils of low ability groups avoided failure. 
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TESTING WORD DIFFICULTY 


WILLIAM DoLcn 
University of Illinois 


Tue basie fact to be remembered in testing for word difficulty is that 
we are testing the words and not the children. When we are comparing 
children with one another as to word knowledge, we must make suv 
that conditions are the same for the various subjects taking the test 
(often imperfections in the test do not matter because thes affect all th 
subjects alike and do not change our comparison of one to another. | 
the present discussion, the situation is quite different. We are compa 
ing words with other words as to difficulty. The conditions must ther 
fore be the same for the different words as well as for the children taking 
the test. Coneretely, this means that the test must give on each word 
neither more nor less help than it gives on any other. Here is the dif 
culty that all so-called objective methods must encounter. Can a test 
which aids reeall by multiple choice, matching items, classification, con 
pletion sentences or the like give just as much help on one word as o: 
another? 

The fact is that objective tests, in aiding the pupil in reeall, do give 
unequal aid on different words. In determining word difficulty we ar 
comparing words with one another. A test which gives more suggestioy 
on one word than on others will get results which make that word seen 
easier than it really is. This unequal suggestion is absolutely inseparabl 
from aided reeall. If we think of ourselves as testing the children, this 
difference between words need not bother us but if we are testing the 
words it is of the utmost importance. This situation will be shown in 
the experimental results presented in this paper. The effect of skillful! 
vuessing is really a part of the same problem. As soon as any help in 
recall is given, it is possible for intelligence to build upon the suggestion 
and get the right answer. And the suggestion upon different words is 
bound to be unequal, so that imtelligence finds some items on the test 
easier than others. 

THE EXPERIMENT 

The following experiment is reported as suggestive of a satisfactory 
method of testing the relation difficulty of the commonest meanings of 
words with older children. It dees not pretend to show a method of 
testing the less usual meanings of words or of testing word knowledge 
at all below, let us say, the fourth grade. Those situations have to be 
studied under their own conditions. 
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TESTING WORD DIFFICULTY 


lirst, 
ty words were presented to them im columns with the instructions 


Chis experiment was conducted with 40 children of grade VI. 


they help the teacher find out the hard werds. They were, there- 


fo. to mark with a zero all words which they did not know at all and 
a question mark the words about which they were uncertain. In 
the scoring, only those words which were not-+marked in either way were 


considered as known. Immediately after this word checking test, the 
na multiple choice test 
this be- 
the printed form of a vocabulary test of good standing. On both 


When taking 


multiple-choice test, the children asked what they were to do if they 


70 words were presented to the children j 


+ the form ‘‘Skill is keenness, anger, grief, expertness ;’ 
tests. the children were given all the time they could use 
They were told to mark any one 


» not sure which alternate to mark. 


thought the right-one. Some guessing was therefore present, but 


since scores on the checking test were in most cases higher, the children 
that 


ne words as known about which they were not entirely sure. 


have been doing somewhat the same thing there, is, consider- 
No comparison between total scores made by the class on these two 


tests would tell us which is the better test. since both tests are on trial.! 
TABLE I 


10 CHILDREN 
[EST AND THE 


VI MEASURED BY A MU! 


Worp Cueckine 


Worp KNOWLEDGE OF GRAD! AS ripLt 


\ comparison of elass knowledge of individual words as determined by the 
two types of test 


No. of Words Difference 
18 Same on both tests 
12 Difference of 1 
“ 9 
6 3 
5 4 
2 5 
2 6 
3 ~ 
2 * 9 
1 ee 10 
4 11 
2 12 
1 13 
1 17 
1 21 
1 23 
70 words 
The table should be read as follows 18 words we known by the same r umber of 
whether tested by either method, 12 m4 re known by ne more child when 
n one of the wavs than in the other, 9 words were known by 2 more children, and so on 


Sims, Verner 
4 Journal of Educational Research. 


M. 


‘‘The Reliability and Validity of Four Types of Voeabulary 


September, 


1929. 


of test is the best by inter-correlation between pupil scores. 
some of the original data showing results on individual words, we could form 
a better idea of the true validity of the various methods. : 


Tries 
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3 ie The point to remember is the one emphasized above that we are int ‘ 
> ested in testing words rather than pupils. Therefore, the significa 
4 results are to be found when we see what happened on individual words 
Sic7t when tested in these two ways. These results upon the separate words 
1S we shall now present. 
if At first the agreement between the results on these seventy words 
“ when tested in two ways may seem surprisingly small, but a study of th: 
ae situation will show that the result is about what could have been e 
a of pected First of all, it the children had repeated either kind of test 
mal second time there would have been considerable variation. Seeond, th: 
ee methods used by the two tests were so different that variation betwee: 
¢ ae them was certain to result. When we have further analyzed results, 
us will seem strange that there was not more disagreement. 
ee | é or purpose ot analysis, let us consider the 20 words, out of the tota : 
ih ‘ of 70, the results on which differed by more than 10 percent of th ! 
pupils taking the test. If we look at what happened on these 20 words : 
we will find a series of reasons why the two tests do not agree. 
First of all, the multiple-choice test caught some guessing which tl 
1s: children had apparently done on the cheeking test. Nearly all ha 
‘ot ae marked the word ‘‘charter”’’ as known, but half of these on the multiph 
Sa choice test said that a charter was a map. They must have been con ‘ 
eee! fusing it, therefore, with ‘‘chart.”’ The evidence seems to show that the f 
ey same sort of thing happened with ‘‘embody’’ and ‘‘limpet,’’ a familia: P 
Beene * part of a word making the children think they knew the meaning of th: P 
whole " 
Second, if the multiple-choice prevented use of partial word knowl- an 
edge with these three words, it assisted partial word knowledge in ever 
more eases. Table IL shows six words with the alternates given on the I 
a multiple-choice test. In the first four cases, a part of the hard word 
~Y 3 was similar in meaning to the correct easy word which followed, as in ; 
the resemblance between ‘*gelatinous’’ and ‘‘jellied.’’ In the ease o 
: ‘*mosaic,’’ if the word had been heard in connection with decoration 
© this idea would have helped the pupils to select ‘‘patterns,’’ as the cor 
rect response. The word ‘‘ape’’ in ‘‘apish’’ would have helped the chil 


dren to decide that of the four alternatives ‘‘silly’’ was the most appropri 
5 ate. The point is that in these six words the big difference between th: 


results on the two tests seems to be explained by the aid which the mul- 
tiple-choice form gave. As emphasized above, any kind of the so-called 


ite: objective test is bound to aid recall. The difficulty is that it does not 
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equal aid on different words. Likewise, as we shall show at once, 
t i\ positively hinder the ehildren from showing their knowledge in 
ase of some words. 
TABLE II 
WorDS ON WHICH MULTIPLE Test AIpED PUPILS 


Checking Dif Wording of Multiple Choice Test 
12 l Gelatinous things are } ied, « t ! Italia 
28 11 \ sportive person is gay, wild, bold 
17 Dispropoert ate al t ug q qua 
7 > An incrustation is a absorption, coating, petrificatior entatior 
14 iZ Mosaic reveals homogenett patterns, melo strip 
- 11 \pish people are cruel, silly, Wise, angry 


Of the twenty words out of the total of 70 that differed most widely 
the 2 tests, we have shown that three are undoubtedly too high on 
checking test, and that 6 are probably too high on the multiple-choice 
test. In Table ILI, we present results which seem to show that of the 
remaining eleven, nine probably are too low on the multiple-choice. We 
believe that examination of every one of these cases will show that there 
was in the multiple-choice form some characteristic that hindered some 
of the children from marking the words properly. In some of these cases, 
such as the one which gives ‘‘singularity’’ as a substitute for ‘‘ peculiar 
the substitute is harder than the original word. In others, such 

sin the ease of giving ‘‘sleep’’ for ‘‘repose,’’ the words are not always 
thought of as the same thing. In other cases, the alternatives were con 
fusing and must have led some of the children to mark the wrong thing 
or omit the item. A very clear case is the word ‘‘roar,’’ not given on 
this table. Surely, all sixth-grade children know what the word ‘‘roar”’ 
means. All 40 of the children in this class marked it as known on the 
checking test. but four of them passed over it on the multiple-choice 
form. When we note that the test said, ‘‘A roar is muddy, tall, soft, 
loud.’ one ean well imagine that some of the children began to be doubt 


ful whether they knew the word or not. In fact, an inseparable part 
of the multiple-choice technique is wrong suggestion, and this is certain 


to shake the confidence of many children. 


TABLE III 
Worps ON WHicH MULTIPLE-CHolce TEST HINDERED PUPILS 


M-C Test Checking Dif Wording of Multiple Choice Test 
5 22 A peculiarity is a circuit, debacle, singularity, ut formity 

) 21 12 Exaltation is intoxication, exhalation, elation, admoniti 

) 40 11 Skill is keenness, anger, grief, expertness 
- 28 39 11 A priceless book is useless, invaluable princely, excellent 

-9 38 io) A shrewd man is weak, dull, sharp, strong 
| 8 16 8 A promontory is a promoter, incognito, foreboding, projection 

18 26 8 A dilapidated thing is laminated, complete, subjected, defaced 
f 4 40 6 Noticeable things are round, little, brave, plain. 

26 31 5 To repose means to sleep, snore, dream, wake. 
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Of the words which varied on the two tests by more than 10 perce: 

of the children taking the test, we have two remaining: ‘‘tolerate’’ an 

civil.’’ The conditions of the testing seem to offer no explanation fi 
the difference in results secured by the two methods We ean find n 
suggestion, therefore, as to which of the tests shows the true amount « 
word knowledge on the part of the children. 

We have here illustrated a characteristic of objective tests which it i 
almost impossible to get away from: with some words they aid the pup 
and with others they hinder him, doing cach in unequal amounts fo 
different words. Consequently they often fail very decidedly in show 
ing us the true relative difficulty of words. In this experiment we wer 
using the multiple-choice items which appear on a standard publishe 
test. It might be argued that these could well be improved upon. Yet 
any multiple-choice items would be subject in greater or less degree t 
the same difficulties. Again we must remind the reader that we are no! 
thinking of fairness to the children, but are seeking to get results o1 
individual words which are comparable with one another. In using an: 
method of aided recognition, it is going to be impossible to give equa 
aid on all words or, as in the eases shown above, to keep from actuall 


hindering recognition in the ease of some. 


COMBINING THE METHODS 

Krom the reasoning suggested by the experiment just described, we 
may propose a method of testing common meanings with older childre: 
which will meet as far as is possible the demands of accuracy and eas¢ 
of applieation. Where large word-lists are to be dealt with, we propos 
that they first be presented to children in a checking test. From this 
test a smaller list of doubtful cases will be secured. We propose that this 
list be then presented to a large number of children first by the checking 
method and then by the so-called objective method. Both of these tech- 
niques are easy to administer. Each one acts as a check upon the other 
beeause the mistakes which one is likely to make are very unlikely to be 
repeated in the other method. 

The two tests will agree on a very large percentage of the words and 
coneerning those words we can then be rather sure that we do know 
the relative difficulty for the particular grade in which they were tested. 
There will remain, however, a group of words on which these two methods 
of testing do not agree. These words may be tested again either more 
widely or with new forms of objective tests to make sure whether the 
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.,vreement is unavoidable. If the difference in results persists, thes 
words would have to be investigated by the interview technique. 
would be possible beeause of their small number. Of course, the 
rview technique would be ehecked by specify ing permissable and non 

missable responses, 
\s explained at the outset, the only final method of determining rela 
word difficulty is by testing. We must insist that test results be 
‘rate. but because of the large number of words and the vast number 
school children, we must also have ease of application. We believe 
composite method outlined above would get these two requirements 
as far as is possible in the largest word testing job that is before us, 
that is. determining the relative difficulty of the ordinary meanings ot 
ls to the children of the middle and upper grades. 
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COMPARISONS OF SHORT ANSWER AND MULTIPLE CHOICE 
TESTS COVERING IDENTICAL SUBJECT CONTENT 


Teachers Colleae, Columbia University 


Vauiprry of test materials is of vital concern. Does a test measur 
what we wish it to measure? Does it measure the desirable outcomes 
of the course? Does it measure the objectives set for the course? B 
fore the advent of the *‘new type’’ tests, ‘‘essay’’ examinations were th: 
most common type of test. The ‘‘new types’’ have been proven mor 
reliable in giving the same rating when repeated. This reliability has 
been gained largely by making less ambiguous, more definite, and mor 
objective test items. Some data have been given to show that ‘‘essay 
tests may be made quite reliable if care is taken in framing test ques 
tions and objective seoring keys are used In general it must be ad 
mitted that ‘‘essay’” tests involve more creative capacities of individuals 


in that they give more opportunity for self-expression. 


The short answer test is the nearest like the ‘‘essay’’ test though 

lacks the creative opportunities of the latter. It calls for a definite ar 
6 swer to a definite query, breaking up the desired ‘‘essay’’ responses int 
more unitary portions, thus steering the student along a path chosen by; 
the test constructor, absolving him from fashioning the pattern of thi 
responses. An uncompleted statement test is probably the next nearest 
relative of the ‘‘essay’’ test but seemingly a trifle less satisfactory thar 
the short answer test on the whole beeause the blanks to be filled in ary 
not always so pointed as the short answer test items. <A series of blanks 
may be filled in so as to give a quite different trend to the thought an 
vet be quite accurate. 

The multiple choice test introduces a quite different element—that o1 
selection among several alternatives. No creative ability is brought int: 
play nor is there any leeway for a student’s choice of words from his 
own vocabulary. Ability to choose the best of several responses is the 
ability required. The test is thus usually 100 percent objective. This 
diseussion presents evidence on computed reliability and validity of th: 


short answer (Form A) and multiple choice (Form B) types of tes' 
when the subject content was planned to be identical in the two. Forn 


% a. : B (multiple choice) was prepared after Form A and each item paralleled 
et ag a corresponding item in Form A. In Form A a definite query required 
x 3 _ a definite response not suggested to the student. He had to furnish the 
: 2 information or judgment from his own accumulated experiences. In 


28 


we | 
- 
A. W. Hurp 
a 
ve 
‘ 
l 
it 
S 
J 
4 
ti 
Ne 
tl 
a 
=, s 
J 


2] SHORT ANSWER VERSUS MULTIPLE CHOICI 29 


B. four responses were suggested, one of which was more nearly 
et than any of the others. He had to select the most nearly correct 
‘the four suggested. For example, item 19 of Form A reads, ** How 


voltage appreciably affeeted when some lights in a house are turn d 


iff The corresponding item in Form B reads, ‘‘When some lights 
house are turned off, the voltage (a) Increases ; b) deereases; (¢ 
( ns the same: (d) constantly fluctuates through a wide range.”’ 


In the first place, Form B proved to be an easier test. On adminis 
tions of both forms after fifteen days ot instruetion in 36 schools on 
eaching unit for which the tests were prepared, the mean scores for 
Morms A and B, respectively, for 1423 pupils were 02.55, and 57.77. 
lhe total possible score on each is 79.) Form B was given one day late 
than Form A without intervening instruction. The two forms were also 
ised as preliminary tests but not with the same pupil groups for each 
Hor 950 pupils in unselected classes, the mean score for Form A was 
”) 14: and for Form B, for 774 pupils, 32.57. The evidence seems con 
clysive that Form A is more difficult especially when used as a prelimi 
nary test. The distribution forms and computed variabilities for the 
| tests are quite similar, the scores showing concentration toward the 
end. For the preliminary test however, the two distributions are 
‘ite different. While the computed variabilities are approximately the 
same. the distribution for Form A shows concentration toward the low 
end. and for Form B, a more nearly normal trend. Percentile graphs 
and standard deviation graphs show that A is more difficult all along 
the seale for both’ preliminary and final scores, 

(‘omputed reliability coefficients by the ‘* split halves’? method are 
93 01 for Form A final, and .82 = .02 for Form B. Form B is less 
reliable probably because pupils are less careful in making the responses, 
lue to its apparent ease. This unreliability of Form B shows up in the 
correlation coefficient between the two forms which is .78 02. This 
indieates also that the two tests do not measure exactly the same fune 
tions. In other words, both are not equally valid in measuring the plan- 
ned outcomes of the instructional unit. 

Two other coefficients of correlation indicate the higher validity of 
Form A. A third form, Form ( was used with a few schools. This is 
the form appearing in a work and test book by the writer.’ For Form 
\. the coefficient with Form C is .88 02: and for Form B, .68 * .04. 


‘Hurd, A. W. Work Test Book in Physics. New York: The Maemillan Company, 
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These coefficients show that Forms A, B, and C do not measure the sa 
functions, t.¢., they are not equally valid for measuring the planned o 


comes of the unit of instruction. In other words, if the unit is plann 


to produce pupil facility in giving correct responses to certain definit 


short answer items, it is not equally well designed to produce puj 
facility in selecting best answers (as in Form B) or giving right a) 
swers to test items in Form C. Test items for instructional units shoul: 
be devised to measure the planned outcomes of the unit in the form 

which they were considered in the unit. The short answer test is pro 
ably the most satisfactory as an objective test. Other ‘‘new types”’ Mii' 


involve different functions which the unit was not designed to exereis 


That Form A is probably superior is substantiated by the comparativ: 


gains made on Forms A and B from preliminary to final test. Thes: 
are, respectively, 32.24 and 25.20. It seems that instruction has pro 
duced a higher gain with Form A and it may be assumed that instruetiv 
produces greater effects in the direction of its planned objectives. Ther 


fore, Form A is a more valid test for the unit. 


While “new type’ tests are novel and interesting, it must be observed 


that they may introduce functions which the unit was never intended 1 
strengthen. A measurement test should be carefully planned to measur 


the intended unit outeomes in order to be a valid measuring device. 


| 


r 


4 

4 

Sig 

al 

P 
i 
y “4 
} 
j 
* 
J 

i 

4 
é Pag 

; 
9 

4 


e 


\ COMPARISON OF THE PERSONALITY TRAITS OF 300 
\CCELERATED, NORMAL, AND RETARDED CHILDREN®* 
EpNA WILLIS McELWwet 
Unaraded Classes, New York City 

(ie personality traits of school children, even when given instrue- 
tion in large groups, are very marked. Some are attentive and inter- 
in their work, while others are talkative, restless, or indifferent. 
Some are disobedient or quarrelsome, but the majority get along well 
with other children. 

The purpose of this study was to make a comparison of the degree 


to which certain desirable and undesirable traits were possessed by chil 


whose school progress had been normal, accelerated, or retarded. 
\ child was considered retarded if he had been left back one or more 
erms An accelerated child was one who had been doubly promoted 
nee or more than once. The amount of retardation ranged from one 
to five terms and that of acceleration from one to three terms. 

In connection with an experiment on retardation at Publie School 
208. Brooklyn, the teachers of the second, third, and fourth grades were 
isked to indieate which of the following characteristies described each 


of the children in their elasses. 


1. Gets along well with other 8. Quarrels with other children 
children 9. Indifferent toward sehool 
” Interested in school work work 
Good effort 10. Exeitable 
(Quiet 11. Talkative 
5. Attentive 12. Restless 
6. Obedient 13. Stubborn 
7. Calm 14. Listless 


rom this group one hundred children were selected whose school 
progress had been accelerated, one hundred who had been promoted 
regularly, and a third hundred whose school progress had been retarded. 
There were fifty boys and fifty girls in each group, with an equal amount 
of retardation and acceleration among both the boys and the girls. 

The first seven traits were considered desirable and the remaining 
seven undesirable. Table I makes a comparison of the desirable and 
undesirable traits for three groups of children, the boys and girls being 
listed separately. 

Miss Mildred Borst and Miss Miriam Eggers, assistant psychologists in the 


Department of Ungraded Classes. New York City, rendered valuable assistance in 


giving and scoring the association tests. 
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TABLE I 
PERSONALITY TRAITS OF 300 ACCELERATED, NORMAL, AND RETARDED CHILDRED no 
Accelerat N Retard er: 
Roys Girls I Boys ¢ Tota Boys Girls I 
ab tie 
i along w } 16 4 2 6 oR 
Interes work 45 42 87 6 69 19 ol 
Good Ef 1 42 ao og Ia 1 
Quiet 53 17 2 17 24 
be Attent 66 14 16 23 ot} 
2 65 ) 24 4 
Ca 17 7 7 7 12 ! se] 
I sirat 
Qua le w ) 6 7 13 1 
I Terent 1 0 ’ 18 21 11 tri 
Excitable 4 l 15 6 
lalkative 20 12 21 24 
Restless 8 ‘ 1 I: 14 26 12 
Listle 1 2 7 
ol 
The differences in personality traits between the boys and girls we ” 
practically negligible, except in the group of retarded children. (In tl ai 
group the girls were more attentive and more interested in their seho: _ 
an 
work than the boys. They were also less restless and less indifferen: 
oo toward their school work than the bovs. 

4 
aa ae rhe desirable traits for the three groups of children are shown grap! 

ae ically in Chart I and the undesirable traits are shown in Chart II. 17 
A 3 open bar represents the accelerated children, the solid bar the children J 
Str who have made normal sehool progress, and the bar with diagonal lines 
a 
the retarded children. 
iil 
CHAI I. COMPARISON OF DESIRABLE CiaArtT Il. COMPARISON OF UNDESTRABI 
” RAI FouND IN 300 ACCELERATED, TRAITS FouND IN 300 ACCELERATED na 
= NORMAL, AND RETARDED CHILDREN NORMAL, AND RETARDED CHILDREN In 


Gets along Qua me 
toward 


Interested 
Te 
Good effort — 


Accelerated 
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By comparing the two charts it is very evident that all three groups 
possessed more desirable than undesirable traits. In general, the accel 
erated children seemed to possess to a greater degree all the desirable 
traits than did the retarded children The reverse condition was true 
of the undesirable traits. 

Further analysis shows that all three groups got along well with 
other children. The accelerated children excelled in their interest in 
school work and in good effort. With the exceptian of attentiveness, they 
possessed all the desirable traits to a greater degree and the undesirable 
traits to a less degree than the other two groups of children. 

The retarded children were markedly disinterested in and indifferent 
toward their school work. ‘Their effort was considerably less than that 
of the children whose school progress had been normal. Although the 
retarded children were the most disobedient of the three groups, they 
compared favorably with the children of normal school progress with 
regard to quietness, calmness, quarrelsomeness, stubbornness, excitability, 
and talkativeness. 

rhe Kent-Rosanoff Association Test was given individually to forty- 
five of the children who possessed several of the undesirable personality 
traits. All of them were considered conduct problems by the school, 
and twenty-two of them had been retarded in school progress. 

On the association test 4he term ‘‘individual reaction”’ is applied to 
a response which is different from those usually given by normal chil- 
dren. An excessive number of individual reactions given by any one 
person is considered a symptom of emotional instability. Sufficient work 
has not been done with younger children to establish norms for them. 
Investigators’ have found, however, that younger children tend to give 
more individual reactions than those who are over sixteen years of age. 
For the latter group, more than ten individual reactions is considered 
in exeesssive number. The findings on the Kent-Rosanoff Association 
Test suggest that emotional instability may be a causative factor in the 
nti-social behavior of these problem children, as fourteen of them gave 
more than thirty individual reactions, the average number for the group 
wing twenty-four. 

RECOMMENDATIONS 
The principal causes which result in retarding the school progress 


of a child may be classified under three heads: mental, physical and 


1 McElwee, Edna Willis. ‘‘ Association in Normal and Sub Normal Adolescents,’’ 
imerican Journal of Psychiatry, September, 1931. 
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emotional! There is always a reason why a child talls behind his elass 
An examination by the school psychologist will determine his mer 
eapacity and will show whether his grade placement is correct. 1 
school doctor will advise regarding poor vision, impaired hearing, un 
nourishment, or other physical defects which ean be corrected. If 1 
child is quarrelsome or disebedient, and just as surely if he is listles 
and unresponsive, the diagnosis and treatment of the psychiatrist v 
by helpful in removing the causes of retardation. 

When the psychologist, physician, and psychiatrist have done wl 
they can, the rest is up to the teacher. Her greatest problem will be 
create an interest in school work. The results of repeated failure ai 
discouragement, after honest efforts to complete tasks too diffieult f 
them, must be overcome. An activity program which allows for bot 
elass and individual projects may be the means for the retarded chi 
to find himself, 

Two of the problem cases in this study were twelve-vear-old boys i 
the fourth grade. Their educational attainment was even below the lev: 
of that grade. They were placed in an opportunity elass with a mor 
flexible program and a sympathetic teacher. One of the boys shows 
an interest in ships and was permitted to build several models of various 
kinds. He was very proud of his ships and could tell visitors all about 
them. It was the first time he had done anything well at school. B: 
this accomplishment he had regained his self-respect as a member of thi 
group and was no longer a disturbing element in the classroom. He was 
vow willing to try to learn to read, and the words he used in telling 
about his ships were the first ones he learned. 

The other boy was the quiet unresponsive type. The class was build 
ing rabbit hutches for the school garden and he knew more about ea 
pentry than the other boys. He was allowed to direct them in smal 
groups. It was surprising what a difference this opportunity for self 
expression made in him personally. His desire to learn had been awak 
ened and by the end of the term he had completed the work of two terms 
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sTUDY OF THE AMOUNT OF AGREEMENT FOUND IN TITE 
RESULTS OF FOUR EXPERIMENTERS EMPLOYING TIE 
SAME EXPERIMENTAL TECHNIQUE IN A STUDY 
OF THE EFFECTS OF VISUAL AND AUDITORY 
STIMULATION ON LEARNING 


4. S. BARR 


Unive itu of Wisco 
Puk pot has frequently been made that the antecedents of eduea 
tio phenomena should be so controlled and the procedures employed 


Ko reported in experimental studies of education that other experimenters 
may secure upon the repetition of the reported experimenters compara 
bie results. As a matter of faet, the whole program of experimental 
education is based upon the assumption of the repeatability of educa 
tional experimentation. If one examines the experimental studies re 
Jating to a given phase of education, he is almost certain to be impressed 
by the lack of agreement in the results reported by different experi 
menters. While the procedures are almost never identical, some im 
dividuals have interpreted this lack of agreement as evidence of the 


impossibility of experimentation in a complex field such as education. 


With this thought in mind, the study here reported was undertaken to 


determine the amount of agreement in the results of four experimenters 
using the same technique in a study of the effects of visual and auditory 


stimulation upon learning. 


PROCEDURE 

Four experimenters and sixty-four subjects were used in the ex 
periment, each experimenter working with sixteen subjects. The sub 
jects were chosen from members of the freshmen class of the University 
of Wisconsin, from pupils enrolled in the University of Wisconsin High 
School, and from pupils enrolled in two rural high sehools in the 
vicinity of Madison, Wisconsin. All subjects were between the ages of 
Hiteen vears, zero months and eighteen years, zero months. 

The procedure pursued in this study was devised as a group project 
in Edueation 108, Experimental Education, Department of Edueation, 
A niversity of Wisconsin. The materials used for the measurement 01 
Jearning were verbal, consisting of two lists of ten nonsense syllables 
each selected from ‘‘zero association value’’ list of Glaze, and two lists 
of paired associates of fifteen pairs each, selected from a list of sixty 
words taken at random from a psychological study. 
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The two lists were reproduced in mimeographed booklets (know) 
X and Y), one of which was used by the subject in the control (unsti: 
lated) situation, and one in the experimental situation. General di 
tions both for experimenters and subjects were prepared to minimiz 
amount of uncontrolled verbal communication between subject and 
perimenter. These directions and the booklets, X and Y, are reprod) 
below. 

The experiments were conducted in a partitioned booth, about 
feet, in a large laboratory. The subject sat at a table with booklets 
and Y, and the general instruction sheet before him. He was obset 
by the experimenter through a slit in the partition at the rear of 
subject. A telegraph sounder on the subject’s left clicked when 
subject was to turn to the next page of the booklet. 

Auditory stimulation was supplied by means of a buzzer actuated 
ordinary lighting current cut down through a rheostat. The vis 
stimulation was from a 150-watt light. The two, located in the boot 
three feet above and three feet to the left of the subject’s head, w: 
actuated simultaneously by a telegraph key under the hand of the « 
perimenter, the stimuli period being given irregularly in a predetermin 
order and for approximately constant periods of time. Each exyx 


menter followed the same schedule, timing the procedure with a sto; 


watch. A practice period was introduced prior to the experiment prope: 


Each individual acted as his own control. To allow each subject 


to participate in both halves of the experiment, it was necessary 
equalize the difficulty of booklets X and Y. The equalization was ma 
on the basis of the pooled opinions of the members of the class in ¢ 
perimental education. The following learning program was pursw 
by each experimenter. 
S: 1 Control first; booklet X 
Experimental second; booklet Y 
2 Control first; booklet Y 
Experimental second; booklet X 
3 Experimental first; booklet X 
Control second: booklet Y 
Experimental first; booklet Y 
Control second; booklet X 
The same cycle was repeated four times by each experimenter so that i 
the final analysis of group results, practice, fatigue, and relative difficult 


of lists were systematically varied. 
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When each experiment was completed, the booklets were collected and 

j ed. The nonsense syllables were given scores as follows: 3 points for 
ect syllable, 2 for two letters correct, and 1 for a single letter correct. 
- rhe paired associates were scored by giving two points if the words were 

ectly recalled and attached to the proper stimulus word, and one point 
the words were correct but attached to the wrong stimulus word 

' Other data which were collected for each subject were his height, 
eight, chronological age, and L.Q.* 
, GENERAL DIRECTIONS TO THE SUBJECTS 
(page 1) 
(Time 1 minute) 

We want to discover some facts about memorizing. The value of 
" ir work depends as much upon how well you follow directions as it 
a es upon how well you memorize. 

There are really only two sieps in this experiment: 1. You will be 
sked to memorize a set of meaningless syllables and write what you 
ave memorized; and 2. you will memorize pairs of words and repro- 
iuee upon request as many of them as you can. 

When it is time for you to stop one part of the experiment and be- 

’ vin the next, the key in front of you will click. Follow this one rule 
> throughout the experiment: 
WHENEVER THE KEY CLICKS, TURN TO THE NEXT PAGE, 
fs Do the best that you ean in the time that you have. 
When the key clicks, turn this page. 
(page 2) 
, (Time 1 and 44 minutes) 

; You are to memorize these syllables and then rewrite them from 
memory. Concentrate on the list, learning the syllables by whatever 
method you ordinarily use for memorizing. 
gi) 

meq el) 
wuh zeq 
When the key clicks, turn the page. 
(page 3) 
(Time 4% minute) 

i * Only a partial analysis of the data are presented herein. 
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Write what vou have memorized: 
Do not turn the page until the key clicks. 
(page 4) 
Time 1 and 1% minutes 
Here is a Tist of paired words. Learn the pairs of words reprodu 
below so that when you see the first word of each pair you can WI 


the second trom memory. 


secure while whieh about 
trend smash arise labor 
steel anger shoot fault 


When the kev clicks, turn the page. 
(page 0) 
(Time 144 minute 
In the space following each word write from memory the word ass 


ciated (paired) with it. 


which sceure 
steel shoot 
trend arise 


Do not turn the page until the ke \ clicks. 


(page 6 


booklet whieh lies in the left-hand corner of the table a 


Take The 
begin work on at onee, 


The key will not click again until vou have finished page 1.) 


BOOKLET X 


(page 1) 


Time 3 minutes 


Memorize the following list: 


dlax xad 
vuk 
gah hyh 
jex vat 
vil gaq 


Work until the key clicks. 
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(page 


Time 1 minut 


List 1 
Write what you have memorized: 
Do not turn the page until the key clicks 
(page 3) 
(Time 3 minutes 
f List 2 
Memorize the following pairs: 
basic later china other 
« phase order sense ideal 
dream center innate vive 
stand some type then 
; habits term content drama 
skill often form haunt 
tacts delve earry simple 
most until 
Study until the key clicks. 
nd (page 4) 
(Time 1 minute 
; 
In the space following each word write from memory the word asso- 
ciated (paired) with it. 
dream stand 
habits phase 
tacts skill 
sense basie 
. 
type china 
form innate 
most content 
carry 


Do not turn the page until the key clicks. 
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BOOKLET Y 


(page | 


Time 3 minutes 


Memorize the following list: 


zit qih 
vex met 
vim wub 
jid cet 
xe] sij 


Work until the key clicks. 


(page 2) 
(Time 1 minute) 


List 1 


Write what you have memorized: 


Do not turn the page until the key clicks. 


(page 3) 
(Time 3 minutes) 
List 2 


Memorize the following pairs: 


idea here nature part 
bias shred eon rose 
tense brush toned ball 
yout rule leave orchid 
datum food pencil unable 
social rack value monism 
work evoke even upon 
norms — grape 


Study until the key clicks. 


(page 4) 
(Time 1 minute) 


List 2 
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In the space following each word write from memory the word asso- 


| (paired) with it. 


tense — gout 
datum idea 
norms social 
nature - work 
toned eoin 
pencil leave 
even bias 
value 


Do not turn the page until the key clicks. 


RESULTS 
rhe data collected by the four experimenters were examined from 
ir points of view: 1) The results secured by the four experimenters 


ere examined for consistency; 2) the results secured by the four ex 


erimenters were compared with the composite result for all subjects 


nd experimenters; 3) the results secured by each experimenter were 
ompared with those secured by all other experimenters; and 4) the 
spread of the seores secured by the four experimenters was compared 


the assumption that experimental errors should increase the sigmas 


the distributions. Any unusual fluctuation in the subjects of a given 
x<perimenter should thus be detected. 

The mean seores obtained by the four experimenters are reproduced 
n Table I. The differences for the means of the control and experi 
mental situations, for the four experimenters, are reproduced in Table 
Il. When the size of the several means are compared they appear to 


iry at random except for experimenter Z whose results are consistently 


TABLE I 


s OBTAINED By Four EXPERIMENTERS WHOSE SvuBJEcTS LEARNED NONSENS! 
SYLLABLES AND PAIRED ASSOCIATES UNDER EXPERIMENTAL AND 
CONTROL SITUATIONS 


CONTROL SITUATION 


Nonsense Syllables Paired Associates 
Mean Mean 
19.38 ) 6.42 1.61 
16 1 16.00 7.08 1.49 
16 19.0 ».16 1.29 14.19 8.18 2 
Q 16 18.25 5.10 1.28 16.19 6.39 17 


EXPERIMENTAL SITUATION 


Nonsense Syllables Paired Associates 
Xx 16 17.81 6.18 1.55 11.44 7.26 1.82 
Y 16 16.88 5.36 1.34 14.75 8.18 2.05 
/ 16 15.63 6.40 1.60 13.19 6.94 1.74 
W 16 13.38 6.56 1.64 14.69 6.63 1.66 
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aera ict lower than those secured by the other experimenters While there 
aj "| considerable variation in the differences between the means of the c 
yeh trol and experimental situations secured by the four experimenters, 
- no instance are these differences statistically significant. The differen 

are greatest in the case of experimenters Y and Z for nonsense syllab! 

: x the critical ratios being 2.81 and 2.15 Even in these instances the d 


ferences may he attributable to errors of sampling. 


TABLE Il 

aa i: \ COMPARISON OF THE DIFFERENCES IN THE MEANS SECURED BY THE Four EXI 

UNbeR THE CONTROL AND EXPERIMENTAL SITUATIONS 


NONSENSE SYLLABLES 


\lea Litt ‘ true ff. creat 
} s | tat thar 
\ 7 2 02 7s 
7 4.37 l 
Q l ..08 6 
: PAIRED ASSOCIATES 
X | ~.42 157 94 
y i4 Hb 
l 2 68 4 
YQ 1.50 41 6 74 


TABLE 


\{ SUMMARY OF THE RESULTS SECURED FOR ALL SUBJECTS AND EXPERIMENTERS 
N se Syllables I ed A ate 
} il ‘ ty Exper ental Control 
Sj at Situation Situa Situat 
Mea l 19.73 l l 
ot ‘ 6 7.44 7.44 
oa i o.93 
pitt 6 
dif 1.0380 1.315 
ae Critica ia 2.45 1.43 


ae TABLE IV 


\ COMPARISON OF THE DIFFERENCES OF THE DIFFERENCES OF THE MFANS BETWE! 


im rue CONTROL AND EXPERIMENTAL SITUATIONS FOR THE SEVERAL PAIRS 
or EXPERIMENTERS 
the NONSENSE SYLLABLES 
Chances in 100 
Dif. of Critica a true diff 
snerimenters 1 Dit S_D.aier. of aire Ratios greater than ze! 
\ x 2.79 1.39 92 
X Q 1.70 an 73 
Z 1.06 a2 65 
y Q 6 2.84 1.96 9s 
/ Q ) 2.92 1.54 


PAIRED ASSOCTATES 


6s 75 
3.60 83 
3.42 68 75 
$92 24 60 
3.74 7 50 
63 
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2.56 
Xx Z 50 
X-Q 2.81 
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\ composite of the results seeured for all subjects and all experi 
enters Is re produced in Table IL]. While the differences presented in 
lable IIL are not statistically significant, they favor the control situation, 
\! examination of the differences secured by the four experimenters 
lable IL) indieates a similar result, the means, except one, favoring 
e control situation. The differences here as in the cOM posite results 
are statistically insignificant. A comparison of the mean differences 
hetween the control and experimental situations for the several pairs ol 
experimenters Is presented in Table LV. While there are variations in 
the results secured by the four experimenters, in no instant are the 
mean differences statistically signiticant. Finally, the spread of the 
distributions secured 1 the different experimenters Is presented in 
Table V. The differences (Table VI) are, however, in no instant sta 
tistically significant. 
TABLE \ 
ruk SIGMAS OF THE DISTRIBUTIONS SECURED BY THE FourR EXPERIMENTERS 


CONTROL CONDITIONS 


Nonsense Syllables Paired Associates 
go ais o di oo 
5.2 919 64 1126 
. 2.08 7.98 1411 
91 5.18 1.446 
Q 01 6.89 1.218 

EXPERIMENTAL CONDITIONS 

Nonsens Syllables Paired Associate 
Xx 6.18 1.092 7.26 1.28 
>. 36 947 S.18 1.446 
Z 6.40 1.131 6.94 1.227 
Q 6.56 1.160 6.6 1.172 


TABLE VI 
ru STATISTICAL SIGNIFICANCE OF ru DIFFERENCI IN THE SPREAD OF SCORES 
SECURED BY DIFFERENT EXPERIMENTERS 


CONTROL SITUATION 


nters 
N se Syilables Pair \ ate 
Sigma Critica sigma ‘ tical 
Differences liff Rat Differences ff Ratios 
xX 1.345 28 1.56 1.811 
X-Z 1.29 1.76 1.839 57 
X-Q 10 1.287 i7 1.666 
06 1.282 47 1.29 6s 
EXPERIMENTAL SITUATION 
Nonsense Svyilables Paired A at 
1.445 567 92 1.9 
Z 1.572 140 ) 179 
Q-X 1.593 239 6 738 
Z y 1.04 1.475 7 1.24 1.806 654 
Q-Z 1.620 O99 1.697 183 


7 
4 
sy 
= 
| 
> 
> 
‘ 


44 JOURNAL OF EDUCATIONAL RESEARCH [ Vol. 26, Ne 


SUMMARY STATEMENT 

1) The purpose of this study is to test experimentally the amow 
if agreement found in the results of four experimenters employing t! 
same experimental procedure in a study of the effects of visual an 
auditory stimulation upon learning. 

2) The results show that four experimenters working under cond 
tions similar to those in this experiment can secure comparable results. 

3) While the number of cases employed in the experiment here 1 
ported was small the writer believes that the procedure is suggestive « 
a means that research workers may employ in testing the adequacy « 


exp rimental techniques 


SOME SUGGESTIONS GROWING OUT OF THE EXPERIMENT 
The writer believes that the repeatability of experiments Is a matte: 


of some importance. On the basis of this belief and the foregoing dat: 


he should like to offer the three following suggestions to both consume! 
and producers of researeh : 

(1 Many of the so-called conflicts in experimental results are reall: 
not conflicts but experiments whose procedures, methods of measure 
ments, and subjects differ in some significant respects. It is frequently 
said that if one were to choose a half dozen experiments relating to 
viven field of education one would find little or no agreement in the ré 
sults. While this is, in a manner, true, it is also true that the critical 
reader will find in these researches not identical experiments with con 
flicting results bat experiments unlike in some material respects. This 
point is well illustrated by the foregoing experiment. (2) A useful sta 
tistical tool somewhat recently introduced into educational research, but 
one which needs to be employed with considerable care, is the critical 
ratio. The purpose of this statistical device is to test whether or not 
the differences obtained in experiments may have arisen from chance 
fluctuations in samples. If one were to draw six balls at a time from a 
box containing an equal number of red and white balls one would not 
expect to obtain exactly the same number of red and white balls on each 
draw. One would expect a certain amount of fluetuation in the propor- 
tion of balls drawn. These fluctuations are well illustrated in Table II. 
On the other hand, if one were in ignorance about the number of red 
and white balls in the box and continued to draw a larger number of 
one color than of the other, one would probably suspect eventually that 


the box contained more balls of this color than of the other. The prob- 
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lity of this being the true situation is expressed by the critical ratio. 
When this ratio is in the proximity of three it Is customary to say that 
e differences are statistically significant It should be remembered, 
wever, that this significance is merely one of sampling and that it does 
not supply information about differences emanating from the numerous 
ther unseen and uncontrolled variables of one sort or another. 3 
rhe third suggestion that the writer should like to offer grows out of 
the use of the argument from consistency: when one possesses a certain 
body of materials, instead of treating them as a whole, it is frequently 
lesirable to divide them at random into smaller samples, and to study 
each sample independently. Or better yet, it is sometimes desirable to 
provide, in the plan of the experiment, for a number of smaller experi 
ments which, when repeated under similar conditions, constitute the ex 
periment as a whole. . Besides the variations due to errors of sampling 
there are others due to fluetuations in the performance of the subjects, 
> inintentional changes in procedure, ete. By the use of this device the 
experimenter introduces, as it were, evidence of the repeatability of his 


own experiments, 
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LCRITICAL SURVEY OF PUBLIC SCTLOOL COURSES OF STUD) 
PUBLISHED 1929 TO 1931 
a Henry Harare 
} Western Reserve University 
and 
ALIcE J. BAYNE 
Collinwood High School, 
Cleveland, Ohio 
: In February, 1950, we presented in this journal a critical survey of 
ree courses of study published in 1928-1929. At this time, we present ’ 
dee. similar study of curriculum bulletins published in 1929-1931. In the 
An course of the discussion we shall introduce related data concerning eur 
7 riculum collected informally by the authors and others. In a measur 
this study is a further inventory of the status of the curriculum making 
movement, as far as it is reflected in the published courses of study of 
city and state school systems. For each bulletin, we recorded our data : 
on the following blank: 
iat SURVEY OF COURSES OF STUDY 
E $7 Note: Underline the answer, or fill in the blank space. ' 
a 1. Were consultants engaged in the making of the course of study? a) none, 
! general consultants, « subject specialists, d) both. 
a 2. Who was at the head of the program of curriculum revision? a) director of 
curriculum, b superintendent, assistant superintendent, d supervis 
e) principal, f) teacher 
Does it include an introductory statement? Yes, No. 
t. Which of the following does the introductory statement include? a) _ basic 
views on education, b) basic views on the subject, ¢ general objectives of 
“ the subject, d) nature of unit of work, e) tests, f) learning equipment and ; 
A: af supy lies, general suggestions to the teacher. 
>. Does it inelude objectives? Yes, No. 
6. Are the objectives: a) specific, b) general. 
P 7. Does it tell how objectives were determined? Yes, No. ' 
he Fis 8. Is the course of study subdivided into parts called units of work? Yes, No. ’ 
9. Are they large units or small units? Large, Small. 
> 10. What is the nature of a unit of work: a) eomplete experience, b) a center of ‘ 
Pee i child interest, ¢) theme or principle, d) graded step or process. 
ae ie 11. Does it include procedures (tell how the aetivities are carried on)? Yes, No. 
12. What is the typographical form? a) parallel columns, b) organized paragraphs, 
we ¢) organized outlines, d) informal account. 
16 
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Does it include sample tests? Yes No. 


How does it provide for adapting instruction to individuals? a) instruet 
sheets, 1} two or three separate procedures, ¢ levels of difficulty, d) extra 
SSIOTMENTS, 

I< there evidence of experimentation before adopting the course of study? Yes, 
No 

ta project curriculum (a series of activities without regard to subject boun 
daries)? Yes, No. 

7. Is any researeh reported on a) objeetives, | learning studies, « grade place 
ment, d) curriculum appraisal, e) time allotment, ft individualizing in 
struetion 

S. Is the course of study printed or n imeographed? Printed. Mimeographed 


What is the quality of the typography ? a) very good, hb rood, ¢ averuge, 
1) poor, e) very poor. 
Does it provide for the use of: a) single textbook, b) list of references, ¢) both. 
How many pages does the course of study contain? 
We analyzed 317 course of study bulletins from 72 school organiza 
ons which sent us their publications. All types of school systems are 
epresented in our eollection. The distribution of these organizations as 
population is shown in Table I. 
TABLE I! 


POPULATION OF CITIES REPRESENTED IN 317 CouURSES OF STUDY 


Population Number Population Number 
Over 250,000 17 1 t 5,000 6 
1 to 250,01 13 Under 10,00 1 
to 100,000 14 State, Count and Territory 17 
to 50,000 4 
Total 72 


Geographically, the school organizations, whose courses of study we 
inalyzed, represent every part of the United States. They are distributed 
s follows: New England, 10; Middle Atlantic, 10; East North Central, 
15; West North Central, 14; South Atlantie, 7; East South Central, 1; 
West South Central, 4; Mountain, 2; Pacifie, 8; and Territory of 
Hawai, 1, 

CHARACTER OF THE OUTPUT OF COURSES OF STUDY 

Table IT shows the distribution of the courses of study among the 
various subjects and grades. A comparison with our earlier tabulation 
shows several new tendencies. There was a marked inerease in the out 
put of courses of study in commercial education. The appearance of 
seven bulletins in safety education establishes a new category in our 
list of courses of study. Seventeen activity curricula are included in the 


ollection we studied which will be discussed later in a separate section 
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Classified under the heading of language, three courses in library pr: 
tice have made their appearanee. Not included in our collection 
courses of study but reported in a recent survey of curriculum activit 
of city and state school systems are new bulletins in process in the fie] 


of guidance and eharaeter edueation. 


TABLE II 


OuTPUT OF COURSES OF Stupy By Supgects (1929-1931) 


Junior 
Total Pri Inter- Elemen Total Tunior Senior and Tota 
all mary mediate tary Flemer High High Senior Secor 
grades tary High ary 
Activity ¢ a 5 7 1 
Ger sl s of Study 16 1 1 11 2 
Art l ; 8 2 4 1 7 
( ial Subjects 0 11 ; 6 
Language 21 12 2 
Handwriting 6 1 3 4 l 1 
Health and Physical 
Edueatio 25 1 2 11 14 3 6 2 11 
Hon I Lies 10 1 1 2 4 4 8 
Industrial Art 12 4 4 2 1 8 
Language 38 4 3 17 24 7 6 1 14 
Mathemati 26 4 7 14 7 1 12 
Musi 10 2 7 9 1 l 
Safet Education 6 6 6 
Social Subject is 14 1¢ 18 
Ss 2¢ 1 l 5 7 7 12 19 
Total 26 28 140 90 29 177 
* Nine additional activity curricula are listed under social studies, arithmetic, ete 


As reported in our earlier study the sum of the separate courses i 
history and geography is greater than the number of social studies courses 
This seems to indieate that integration of subjects within the field of th 
social studies is not proceeding as rapidly as one would expect. This 
borne out by an independent study of fifty-seven intermediate histor 
courses of study made by Hannah M. Lindahl' covering roughly the sam: 
period of time as our study. She found that only four of the fifty-sever 
courses were fusion courses, in whole or in part. Furthermore, course 
of study labeled social studies do not indicate a fusion of history and 
geography in the majority of the cases. 

Besides the commercial subjects referred to above the largest output! 
was in the fields of the social studies, language, mathematics, health, and 
foreign language. The number of bulletins in secondary education ex 
eeeded the number in the elementary grades two years ago as well as ir 
our present inventory. This probably indicates that curriculum making 

*Lindahl, H. M. ‘‘History in the Intermediate Grades,’’ Elementary Schoo! 


Journal, December, 1931, pp. 257 265. 
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the secondary grades is catching up with the elementary grades whieh 


1 ded to eurrieulum revision earlic r in the decade. 


ADMINISTRATIVE ARRANGEMENTS 

As the curriculum making movement grows, new and varied experi- 

os in administration are reported. The head of the program, the con- 
iitants employed, the special departme nts ereated, and the cooperative 

ngements with teacher-training institutions differ from place to 

ce. In several eases in which the bulletin is the product of an exten 

e and elaborately organized program, the organization is set forth in 

hart. 

The most revealing conelusion from our analysis is the important role 

it the teacher plays in curriculum construction. Not only do teachers 
orve on most curriculum committees, but in 178 instances they also either 
eaded the project or shared in the leadership with administrative officers. 
; e teacher is the leader in the building of single courses of study more 
an three times as often as any other school officer and as frequently 
; all administrative and supervisory officers combined. The principal 
nears in the réle of committee chairman only seventeen times which 

; the least frequent. 
Curriculum revision is continuing to make headway not only because 
' t is intrinsieally justifiable, but also because it has developed into a most 
feetive instrument of constructive supervision. Thus, a number of 
school systems have delegated the function of curriculum revision to an 
} ssistant superintendent among whose normal duties is that of suner- 
sion. Fifty-three of the courses of study analyzed were revised by 
mmittees headed by a superintendent; sixteen were headed by an 
ssistant superintendent; and fifty-five were headed by supervisors. It 
s reasonable to assume that these programs of revision had the function 

improving instruction as well as modernizing the courses of study. 

In several instances the assistant of the regular and extension depart 
ments of nearby universities has been enlisted. The University of Ala- 
ama furnished three lecturers and incidental supervisory assistance to 
the Bessemer, Alabama, Publie School program of curriculum revision. 
' lhe Little Rock, Arkansas, courses of study have been revised with the 

} assistance of the State University Extension Service. The Department of 
| Extension Teaching of the University of North Carolina assists schools in 
curriculum revision. The Tulsa, Oklahoma, Public Schools have sent 


vroups of teachers to the University of Iowa and to Columbia University 
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for the express purpose of building new courses of study. The Univers: 
of Nebraska joined the State Department of Publie Instruction in 
preparation of a high school curriculum. The construction of the W 
cester geography course of study was supervised by the Department 
Geography of Clark University. Some of the Indiana state courses 
study were prepared by teachers in seminars at the Indiana Univers 
Both the South Dakota and Virginia State Departments organized sti 
programs with printed manuals for several thousand teachers prelimin 
to eurrieulum revision. 

The director of curriculum was the presiding officer in the revision 
thirty-nine courses of study, representing nine school organizations. 
following school systems have organized bureaus or departments of ev 
riculum revision since our last survey: Chicago, Ill; Sacramento, Ca 
Minneapolis, Minn.; Detroit, Mich.; Binghamton, N. Y.; and ¢ 
South Dakota State Department. In all, there are about a seore 
school systems which report special bureaus of curriculum revision. | 
four school organizations, the Bureau of Research was wholly or p: 
tially responsible for curriculum revision. These were Hawaii; Clew 
land, Ohio; New York, N. Y.; and Lynn, Mass. We reiterate our opir 
ion that if the ereation of a separate bureau effects a separation betwee) 
eurriculum construction and the regular supervisory program it is u 
wise, Supervisory officers should school themselves in the art of eu 
riculum construction and should systematically devote a large part 
their time to this work. 

Large school systems find it to their advantage to retain general and 
speelal consultants to assist them in curriculum revision. Twenty 0! 
the courses of study analyzed report the assistance of general eonsult 
ants; twenty report the assistance of subject specialists ; and thirty rt 
port the assistance of both general and special consultants. Consultants 
serve their school systems from several days to several weeks and i 
some cases follow up their personal conferences by correspondence 
Nearly half the school svstems represented by the bulletins analyzed e1 
gaged consultants for one or more of their courses of study, showing 
that it is common practice to enlist the coéperation of specialists. 

THE INTRODUCTORY STATEMENT OF THE BULLETIN 

Ninety percent of the courses of study inelude an introductory stat 
ment which varies in length from two to thirty pages. In 61 pereent o 
the courses of study the general objectives, the broader goals of the sub 


jeet are given. The basic views underlying the learning of the subject 
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given in 50 percent of the bulletins. General suggestions concerning 
ining procedure are found in 48 percent of the courses of study. The 
sie views on formal education are set forth in 15 pereent of the bulle 
ns. A description or enumeration of the learning equipment and sup 
lies is ineluded in 10 pereent of the courses of study. A diseussion of 

. nature of a unit of work is found in 4 percent of the courses of study, 

though certain implications as to its meaning are to be found in the 
section devoted to fundamental educational principles. The topics of 
rade placement, time allotment, adapting instruction to individuals, 

d the criteria for evaluating units of work are found in a handful of 

urses of study. Thus the introduction consists mainly of the basic 
hilosophy or theory of the course of study plus certain teaching or 
earning suggestions, 

While it is not always true that the theory as set forth in the intro 
duction and practice as described in the body of the course of study agre+ 
every school system should have a philosophy of education. It ts, there 
ore, surprising that nearly nine-tenths of the courses of study fail to 
include such a statement. Particularly important is a discussion of the 
nature of a unit of work or the eriteria for evaluating a unit of work. 
Curriculum workers are groping for an understanding of the nature 
of the basie learning unit. It would be helpful if those who are dealing 
with this problem in a practical way would tentatively devote a para- 
vraph to this important element. 

Only ten percent of the courses of study discuss equipment, room 
furnishings, and learning supplies. The physical setting is a faetor in 
determining the learning atmosphere and is fundamental to a life-like 
activity. Every classroom is a work-room, a laboratory—abundantl) 
stocked with materials—among which printed materials are only ele 
ment. If this view is to prevail it must get itself written into courses 
of study. 

THE INCLUSION OF OBJECTIVES IN COURSES OF STUDY 

The bulk of courses of study ineludes objectives. Our tabulation 
shows that 68 percent of the bulletins include objectives. However, 
only 50 percent of the courses of study included specifie objectives. While 
this is a slight inerease over the percent we found in our study two years 
ago, it still represents a sizeable deficiency in curriculum making. The 
specifie objectives are the pupils’ meaningful goals and furnish the 
direction for the day-by-day activities of the pupils. They show the 


way out of our present practice in our schools of dispensing knowledge 
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in tiny eapsules. We include in the eategory of objectives the pupi 
self-determined goals found in a small number of courses of study. Abi 
30 pereent of the bulletins include general objectives. These are usua 
found in the introductory portion of the course of study and repress 
the few broad goals of the subject as a whole. They have only limit 
value in planning the details of the pupils’ daily experiences but t! 
do suggest the more general achievements of the pupils. The courses 
study which do not give objectives, and these are 30 percent of f 
whole number, belong to the antebellum period of eurriculum maki: 
when a syllabus and a course of study were synonymous. 

It would advance the cause of education if every course of study l 
cluded a brief statement of the procedure whereby the objectives we 
selected. It is not here proposed that the procedure shall be of an « 
jective rigorous nature nor is it expected of every course of study. |! 
does, however, enable the reader to interpret and evaluate the course « 
study, and, what is equally important, it is helpful to organizations 
which are undertaking new programs of curriculum revision. Of 317 
courses of study analyzed, only eight or less than 3 percent of the whol 


number tell how objectives were selected. 


UNITS OF WORK 

There is no doubt that courses of study are more frequently sul 
divided into units of work than ever before but there would be consid 
erable difference of opinion as to the frequency depending upon one s 
eoneeption of the term unit of work. In our analysis, we took the vie 
that a unit was a clearly defined subdivision of a course which had unit 
or completeness, although its unity may have been based upon any 0 
the following factors: a child or adult experience, a center of child in 
terest, a theme, a principle, a topic, or a graded step. From this view 
point, 78 pereent of the courses were subdivided into units of work 
Of these courses of study, 80 percent of the units were based on graded 
steps or processes such as, percentage (arithmetic), machines (physics 
circulatory system (health), the halogens (chemistry), ete. This does 
not represent a radical change in organization or treatment of forma 
courses but it does definitely annihilate the lesson as the basie unit of 
eourse of study. Eleven percent of the unitary courses of study wer 
based upon a center of child interest, such as, Play City or Trains; nin: 
percent were based on a theme or principle, such as Transportation or 
Swiss Life. The latter two groups combined represent a sharp break 


with the past, 
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Aecording to Mr. Henry ©. Morrison, a unit of work is ‘‘a compre 
nsive and significant aspect of the environment, or of an organized 
nee, capable of being understood rather than capable of merely being 
morized.’” Mr. Herbert B. Bruner says that ‘‘a unit is so organized 

t everything that is included in the way of content, the organization 
itself, and the method of presenting it to the class is for the purpose of 

king it possible for the child to grasp the big understanding or theme 
hat is back of it.’ A unit of work as it is conceived by the staff at the 
neoln School is ‘‘a series of worthwhile experiences bound together 
round some central theme of child interest. Some incident serves as 
starting point to arouse such an interest; activities of a compelling 
ture further stimulate this interest; information from almost every 
ranch of knowledge is drawn upon to answer the questions that arise; 
ndividual expression of this interest is encouraged through various 
edia.’”* 

It is our view that a unit of work is a complete experience based upon 
: meaningful situation in child or adult life. The unit is a fusion of 
mental, emotional, and sensory experience; it proceeds in a physical and 
social setting that resembles life, as far as possible; and it is directed 
toward the accomplishment of a goal that results in some improvement 
in life. More than any of the preceding definitions, ours emphasizes units 
if human experience, child or adult, as a basis of learning units. 

Of the courses of study that contained units of work, 10 percent were 
large units, that is, those that had a duration of a month or more, and 
9%) percent were small units. The word unit is an elastic term. Ae- 
cording to the conception of Mr. Morrison, Mr. Bruner, and the Lincoln 
School, discussed above, the unit is large, usually lasting at least six 
weeks. It is our view that a unit of work is usually relatively small, 
lasting several days, a week, or several weeks. However, the length of 
the learning unit depends somewhat upon the related life activity such 
as, The Care of Pets (elementary science); A Candy Sale (integrated 
activity); The Roman School: What It Was (Latin); The Literary 
Magazine (language) and so on. It is our opinion that none of these life 

? Morrison, H.C. The Practice of Teaching in the Secondary School. (Chicago: 
University of Chicago Press, 1926), p. 182. 

truner, H. B. The Place of Units in Course of Study Construction. Bulletin 
No. 2. (Pierre, South Dakota: State Department of Public Instruction, 1930), p. 10. 


‘Keelor, K. L., and Sweet, M. Indian Life and Dutch Coionial Settlement. 
New York: Bureau of Publications, Teachers College, Columbia University, 1931), 
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activities requires an especially protracted learning unit. The objecti: 


to long units is that unless they are broken up into smaller pieces, thy 
encourage digressions. They do not help the pupil and the teacher 
mark definite points of progress in learning. Psychologically, they « 
not furnish the stimulation that comes from the awareness that one 


making headway. 


THE FORM OF THE UNIT OF WORK 

According to form the unit of work is presented in four ways: | 
in outline under several headings; 2) in parallel columns under sever: 
headings; 3) in solid paragraphs under several headings; 4) in i $3 
formal deseription. \n analysis of our collection of courses of stud) 
revealed that 48 percent were in the form of organized outlines; 26 
pereent were in the form of solid paragraphs; 16 percent were in thi 
form of parallel columns; and 10 percent were in the form of informa 
description. Table IIL shows a comparison of form in this survey wit! 


the one we made two years ago. > 


TABLE II! 
COMPARISON OF Form OF UNITS 1930 AND 1932 
Percent of Total 


1930 1932 


242 Courses of Study 417 Courses of Study 


1 Organized Outline 47 

Parallel Columns 27 16 

Solid Paragraphs 19 26 

4. Informal Description 10 

The organized outline seems to persist in being the common form al- } 
though, in our Opinion, it encourages vagueness and carelessness of ex 
pression and it gives the page a broken and irregular appearance. It 
is gratifying to reeord that the parallel column form is becoming less 
common, not only because it is hideous to look at but also because it is 
a stupid waste of space. The increase in bulletins in the form of solid 
paragraphs and informal accounts represents a distinct gain because 
they are clearest and fullest; they make the most attractive printed page ; 


and they conform to one’s normal reading habits. 


THE INCLUSION OF TESTS j 
Despite the voluminous output of printed tests and manuals on test 
construction we are of the opinion that we are still in the primitive 
stage of test making for learning or curricular purposes. The primary 
purpose of the test is to determine whether the goals of a unit or a ; 
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be ek of units have been achieved. Fifty-seven or 15 percent of the 
rses of study included tests of some kind, which is ten pereent more 


were found in courses of study two years ago. These tests are 

, vely of the new or objective type. They do not test for expression 
, | creative ability; they do not test for the ability to organize parts 
/a coherent product; they test for reasoning only to a limited de- 


they do not test for the ability to apply facts, skills, or general- 


they do not test for the accomplishment of child or adult ob 


TIONS: 
tives Beyond the basic discovery of the brief answer and objective 
; oring, ingenuity in test making has run out. It is of fundamental im- 


rianee that the test should be based on the objectives of the given 


and that the test items should elicit life-like responses, 


ADAPTING INSTRUCTION TO INDIVIDUALS 
Phere is an increasing tendency to include suggested methods of 


dapting instruction to individuals. Whereas only nine courses of study 


. : ade provision for individual differences in our study of 1929, the per 
cent rose to twenty-one in our present study. Twenty courses of study 
suggested two or three procedures for ability groups in parallel columns 
or in successive paragraphs. Twenty-four courses of study included 
extra assignments for brighter pupils. 

i Only two courses of study were in the form of individualized self 
‘nstruction sheets or work books. However, these materials are pr bably 
widely used in the form of published work books. Twenty-four courses 
of study made certain miscellaneous provisions such as suggested omis 

sions. suggested variation in rate for backward pupils, suggested extra 
drill for dull pupils, suggested emphasis on more important parts, and 
the suggested use of conerete materials. Nearly all the activity cur- 
rieula. owing to their flexibility, the opportunity for pupil initiative, and 

’ the common subdivision of the labor in a project, provide for a consid- 
erable amount of individualization. The individualization of learning is 
in a more plastic form now than it has ever been and schools which re- 
port suecessful experience in their course of study bulletins by that 
means may contribute to progress in this matter. 

ng To be Continued 
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EDITORIALS 
A MATTER OF HUMAN NECESSITY 
i Y. Emerson expressed a part truth in the couplet 
**From Jove, Prometheus stole his fire 
q And, without Jove, the qood had never been.’’ 
eas History emphasizes the reverse fact that without a Benjamin Frank! ‘ 
aa or another usefully minded doctor the good of science had been litt 
realized. 
a The above is intended to reeall to our older readers the answer giv 
Ey . by the Journal of Educational Research in its first issue (January, 1920 
i and many times reiterated since then, that educational research, pa 
Ore ticularly, can realize the good by making, and then fitting, its discoverics 
| to ways of improving school work. ; 
Exceedingly important as the findings of laboratory research are, its 
generalizations are frequently true only for the controlled conditions oi 
the laboratory. School research has, under the necessity of the situ 
tions, the specific task of discovering relationships true of the less we 
a controlled conditions of the classroom. 
The vital issue involved in an educational service to field workers 
“ga one of means to an end. Will a research service be most effectivel j 
. rendered by means of a pouring in process of merely supplying informa 
ae tion or by the stimulation of the field workers to see and solve problems 
re Without wholly sacrificing the first of these services, the Journal ¢ 
Educational Research aims at the latter believing that the greatest se: : 
oa : vice will be rendered to field workers when teachers, supervisors, prin- | 
eae cipals, and superintendents are stimulated to the solution of their ow 


problems. It is believed that teachers will be happier and more efficient 

in the practice of education when supervisors substitute, for the now 
commonly pursued policy of memoriter textbook training of teachers, a * 
method of problem solving. 

An adequate answer to the question: ‘‘Can a research publication 
be at the same time scientific, practical and readable?’’ involves mor: 
definition of terms than the writer can here attempt. In answer to th« 
question can practical research be scientific, it may be urged that to say 
that a research is practical is no excuse for poor research. Good re 
search involves definition, objective measurement, and the recognition o! 
factors even when those factors cannot be controlled. And finally it may 
be urged that the fact that the reporting of a piece of research involves 
joes a certain technical vocabulary is no excuse for poor expression. The 
Lm difficulties most frequently experienced by lay workers in the reading 
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technical reports are not technieal difficulties but the difficulties of 

y thinking and inadequate expression. 

In pursuit of the afore-described policy, the Journal of Educational 

search wishes to emphasize articles which are directive in character, 
tilizing completed research and studies under way to illustrate tech 

jues and suggesting needed investigations. To this end the Journal 
hall publish : 

1) reports of individual researches offering tentative solutions to 

specifie educational problems, and enumerating carefully defined 

problems for further research; also articles suggesting the tech 
niques of research appropriate to these researches; and 

”) critical reviews of previous investigations carefully differentiat 
ing between fact and fancy and indicating, as in the aforenamed 
articles, issues and techniques for further research. In the pur 
suit of this policy the Journal of Educational Research will put 
primary emphasis upon the instructional activities of the school 
system. 

Believing that a scientific publication should be neither conservative, 
professional, nor radical, the Journal desires to publish experimental 
studies of all of the better developed hypotheses of education. Feeling, 
however, that it is at this time somewhat more difficult to secure care 
fully controlled studies of the less formal aspects of education, the 
Journal desires to give particular attention to this human side of the 
school program, the ‘* whole”’ child, and the newer theories of education 
The whole hearted codperation of both the producers and consumers of 
research is invited in this project. A. S. Barr 


CHANGES IN OUR EDITORIAL STAFF 


The additions made to the directive editorial board indicate the will- 
ingness of specialists in the different phases of the schools’ problems to 
vive time and energy to assist those who must solve, as best they may, 
the immediate difficulties in all divisions of school work. The five new 
workers on the editorial board represent five distinct lines of investiga 
tion of the school situation now being carried on. 

Harry J. Baker, director of the psychological clinic in the Detroit 
publie schools, is a leader among students of the possibilities in the 
school situation. He is concerned for child welfare at every step in the 
educational process. 

Leo J. Brueckner, professor of education at the University of Minne- 
sota, is a leading student and an active contributor in the field of ele 
mentary school work. He is active in the search for better adjustments 
of instructional situations to learning requirements. 

Ernest Horn, director of the university elementary school and pro- 
fessor of education at the State University of lowa, has codperated as a 
leader in work of many investigations during the last twenty years con- 
cerned with curriculum construction and the objectives for different 
types of school work. His leadership in this work is due to very de- 
tailed knowledge of its many phases. 
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Charles W. Knudsen, professor of education in George Peabody Co 
lege. is Fy specialist in the present problems of school supervision and ( 
the psvehology of learning. He has just returned from a year of stud 
and investigation of school conditions in Europe. 

(‘lifford Woody, director of the bureau of educational reference an 
research and professor of edueation in the University of Michigan, ha 
been associated with the Journal since its organization. No director o 
research has kept in closer touch with the actual use of research method 
im the publie schools themselves. 

Our present active board of editors (Barr, Ashbaugh, Good, Bake: 
Brueckner, Horn, Knudsen, and Woody) and the widely distributed lis 
of associate editors, are shock troops for the present critical situation 
The public generally is demanding to know what educational results ea: 
he shown to be worth what they cost. Can better results be realized i! 
present defects are remedied? A vital question is; Are schools trying 
to do more things than should be delegated to them, things that could 
be done better by homes or communities? 


A RESEARCHE OPPORTUNITY IN OUTLINE 

The school is a great research opportunity, taken as a phase of the 
organie growth and of the social integration of child life on its way 
toward mature fellowship in an advancing civilization. Not only must 
the sehool as it is, be analy zed but also the possibilities of better nurture 
and of more complete realization of results must be brought together and 
by experiment, organized for realization. 

A natural situation from which to gather the facts of organie growt! 
in power to learn, and of society’s efforts to determine school education 
here in America, is found in the experiences of our independent settlers 
and in their continued effort to advance school education to meet the 
needs of demoeratic citizenship. <A citizenry independent of foreign 
autocratic control, ready to clear their own lands and build their own 
communities, towns and states, vet appreciative of social organization 
of and by and for all, sought to school their children so that they would 
be free from the bonds of ignorance, and also active as members of an 
advaneing civilization; each one bound to the purpose of doing his part 
to advance the common good. They sought an edueation to advance the 
abilities and the social possibilities of a democratic people. They did not 
plan schools to teach any doctrine of government. Education was to 
provide a common body of knowledge for everyday life, and to enable 
every one to think from given conditions to independent conclusions 
This is an ideal situation for real research as to what the school is to-day 
compared to earlier days, and for the discovery of trends indicating what 
the school may be. 

What the school may be is limited by the opportunities of instruction 
to organize and apply the principles for the nurture of ideas, and for the 
organization of ideas in the processes of thinking. It is limited also by 
the opportunities to bring into play social and mental experiences as 
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itives stimulating the processes oO} learning through yo rsonal asso 
tions for group ends. 
This last limitation is also an imperative, since the progress of eiviliza 
must always depend upon the progress of a genume socialization ot 
dividuals. Isolated personalities, trained er untrained, nullify the 
manent advance of society as a whole. The school must do its part 
aid the community and society to initiate the voung into fellowship 
dl citizenship by developing Integrity of character in all fellowship 
tions and by securing a recognition of the necessity that the acts of 
ry rsonality be directed toward the welfare of SOCcTCTS This is an 
ssential quality of education in a democracy 


lhe American school is tending, though with the apparently blind 

rts of a natural evolution, toward this union between the individual 
nd the social requirements necessary to bring every person under the 
mmon ¢lassification of the gentleman, the true citizen of a democracy. 

Kdueational research is now active in the analysis of the powers and 
nergies at work in the elassroom and for the broader organization of 
school opportunities. This analysis determines for each activity the 
iture of the abilities involved in organizing the activity for learning or 
experience. To some extent research is analyzing the possibility ot 
selecting and adapting the activities of the curriculum beginning with 
ose more direet and simple relations which can be followed by younger 
d less developed minds, and advancing par to the more complex 
d less direct relations of the ideas required for full knowledge and use. 

Much research is needed in this field of adapting subject matter to 

xrowing r abilities (mental age). Abilities do not come into action full 

ed. Involved with the ability to carry on a study is the opportunity 
to acquire the mental skills for consciously bringing together the known 
deas and fitting them with new ideas to extend the organization of 
knowledge and develop new skills. Ability needs mental skills and uses 
them to organize further abilities and to develop other skills. This is 
the process of learning to understand and use the succession of subject 
matter ideas to secure a knowledge of them in usable form. 

To gain skill in applying this knowledge in other connections of 
ought is another learning process, and is related directly to the second 
mitation of the school, that of its opportunities to bring into play social 
s well as mental experiences. Mastery of at least unit bodies of know! 

edge is necessary to the use of skill in applying knowledge to life. 


It is evident, from the close relation of the research concerned with 
what the school may be to the actual school condition under which teach- 
ers and pupils work, that much of the final experimental study of the 
principles and practice for better means of instruction needs to be ear- 
ried on in coéperation with supervisors and teachers. To make the 
relationship more effective the Journal of Educational Research under- 
takes to be a medium for the exchange of experiences, and where possible 
for direet service in the work the schools do to determine improved 
practice, 
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Umstatrp, JAMES G. Student Self-Su; 
port at the University of Minnesota. 
Minneapolis: The University of Min 
nesota Press, 1952. xii -+- 205 pp. 

On most college campuses the develop 
ment of agencies concerned with the part 
time earnings of students has been rather 
casual. The University of Minnesota ap 
pears to have been, until within recent 
years, no exception. 

Professor Umstattd’s study concerns 
itself with a local situation, but the 
methods used and the conclusions reached 
should be of interest to those persons who 
are giving thought to the student who of 
necessity or by choice is partially or 
wholly self-supporting 

The extent and nature of self-support, 
its influence on scholarship, on other 
extra-curricular activities and upon health 
as well as the attitudes of students 
toward it are among the topics discussed. 
The author is able to demonstrate a fact 
hitherto only suspected, namely, that stu 
dents generally do not earn in proportion 
to economic need. Many institutions have 
as a matter of principle insisted that self- 
supporting students carry a reduced scho 
lastie load. This study would indicate 
that such action is ordinarily justified 
only when an excessive proportion of self- 
support is undertaken by the student. 

The chapter on collection and treatment 
of data is, for the ordinary reader, un 
necessarily detailed but would be of in- 
terest to those thoroughly familiar with 
the University of Minnesota organiza- 


tional relationships. Not the least « 
tribution of this study is the list of s 
gested problems for further study « 
tained In an appendix. 
JOSEPH A. PARK 
Ohio State University 


Gray, H. A. Some Factors in the Und 
graduate Careers of Youna Colle ge St 
dents. Teachers College, Columbia 1 
versity Contributions to Education N 
437, 1930. iv + 66 pp. 

Through the analysis of the records 
one hundred twenty-six boys at Colum! 
and twenty-eight girls at Barnard, all 
whom had entered college under sixte: 
years of age, the author has attempted 1 
isolate the factors most influential in th: 
undergraduate achievements and exper 
ences. His objectives are (1 ‘To te 
the necessity for, and the desirability « 


minimum age requirements for college « 


trance,’’ and (2) ‘‘to set up admissi 
eriteria . . . . . which will better enal 


college officers to decide the question 


admission of the individual applica: 
whose chronological age is obviously les 
than that of his prospective classmates. ’ 

Unfortunately, the subjects chosen fi 
this investigation were far from repr 
sentative of the young college student 
in America. They were, for the mos’ 
part, children of Russian Jews of rel: 
tively high educational and occupationa 
status. Three-fourths of the group live 
at home while attending college. Fur 
thermore, Columbia College includes in its 
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e requirements the provision that 


ant be at least sixteen years ol 


quirement which ‘‘is usuall 


after a personal interview 


prospective freshman, the can 


bein 


ves the 


impression OT 

d mentally mature J 
ntelligence of the group as measured 
Thorndike Intelligence Examina 
gh, 86 percent of the group ex 


the mean of the student body of 


ch conditions it is hardly sur 


» that in scholastic achievement, as 
d by grade points, academic hon 
time required for graduation, and by 
entage of the group receiving de 
these young students surpass by 

t general average of the student 
nparison with a control group indi 
: that participation in extra-curricu 
tivities, both athletic and non 

s as extensive for these young 

as for the student body in general. 
thor’s statement that ‘‘the young 

s won more laurels in athletic par 
tio eannot be taken seriously, 


rded the young boys 


tionnaire 


tabulation reveals two letters 
against one in 
ntrol group. 
parison of the two groups on emo 

of un 


The 


r recognizes the limitations of this 


factors shows no evidence 


difficulties among the voung. 


of his study, based on data from a 


submitted to the subjects 


ter graduation. 


Health 


tu 


en the young 


difference 


roup and the controls 


reveal little 


records 


o 


The peculiar selection of subjects defi 


ver, must 


limits the general significance of 


esults for college admission regula 


records of this select 
be taken 


nts three years younger than aver 


The 


as evidence that 
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group, 


age, despite their early entrance, ms 


they possess other requisites, compare 


rably older classmates 


nnesota 


with their 


Vi 


Citv, New York: Doubleday, Doran & 

Compa! Ir 1932. x 538 py 

This book is very much like the others 
in this teacher training series in its or 
vn ition and its philosophy. Whether 
this is an asset or a liability will depend 
upon the attitude and training of the 
reader 

The material used in the book is based 
on the contents of a graduate course of 
the same name taught by the author at 


the George Peabody College for Teach 
As a consequence, the thought and 
book those 
would use on the graduate level. 
a} do 


wok more readable. 


ers, 
which 
The oe 
not help any 


style of the one 


are 


or sentences 


in making the be 
The ‘ 
ondary school that the author attempts 


onception of teaching in the see 
to evaluate and improve is a limited one, 
the 


knowledge and drill outeomes of teaching. 


for his discussion deals only with 
Further, it is based on the assignment and 
These limi 


tations will seem very important to those 


lesson-learning type of work. 


who believe in encouraging pupil devel 


opment through self-direetion and who 
think there are important objectives that 
eannot be classified as skills and knowl 
edge. 

The reader who goes to the book with 
out expecting to find a complete discus 
sion will find much of value on its pages. 
It is well written and carefully edited. 
appeal 


are 


Further, 
Many helpful suggestions 


it presents an attractive 
ance. in 
eluded 


drawn upon to furnish material to justify 


and many scientific studies are 


the conclusions, 
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( troversial matters, however, are not 

s diseussed from all points of view 

ind the reader will be foreed to diserimi 
nate at times. For example, the autho 
spends some time sl owing the tech ue 
that one n ht use in evaluating teach 
ng methods by means of standardized 


tests at the elose of the vear or semester, 


administrators know how helpful a pro 
ram of tests is whose purpose is to aid 
teachers to find out what needs to be done 
They also know how futile it is to try 
to rate tenchers by means of a testing 
program at the end of the school vear 


(nv extensive f tests in the second 


ary school which has for it purpose the 
evaluation of teaching is almost sure to 


dominate the activities of some of the 

teachers until thev do little but eoach for 

the tests Les EF. HOLLEY 
Unive ty of Idaho 


AnpeRSON, J., AND Simpson, I. Jew 
FI The Suj on of Rural School 
New York D. Appleton & Company, 
1982. 167 pp 
This is not merely another hook on the 

principles and methods of elementary 

supervision, but rather it is an excellent 
contribution to the important field of 
specialized problems relating to the super 
vision of rural schools. Out of their rich 
background of experience and intimate 
contact with progressive practices in rural 
supervision, the authors have brought to 
gether a graphic picture of conditions, 
practices and seasoned eriticisms of the 
whole problem of rural school supervision 
that is professionally stimulating and 
helpful to read 

Part IT introduces the problems of the 


rural sehool situation and the peculiar 


needs of Supervisory « ffort together with a 
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brief historical account and evaluation 
the various schemes now being pract 

Part IT treats with fine objectivity 
clearness of vision the prerequisites 
effective rural school supervision ur 
the topies—planning supervisory 
grems, budgeting the time of the su 
visor, and workable daily schedule 
small schools 

Part ITT presents the factual bases 
supervisory pT wedures, namely, object 
tests and measurements, and supervis 
visits to the classroom. 

Part IV offers much of practical vi 
in promoting the professional growtl 
teachers through individual conferen 
purposeful group meetings to n 
teacher needs, demonstration less 
supervisory bulletins, making and int 
preting the course of study codOperatin 
with teachers, and the rejuvenation 
the county institute. 

Part V gives an unbiased appraisal 
the value of supervision in rural seho 
and indicates needed research in the ma 
unsolved problems vet remaining in t 
field 

There is evident throughout the volu 
na sound philosophy of education, a n 
ern seientifie approach to the probler 
presented, and a skillful presentatior 
practical suggestions to make effect 
modern principles of edueation in ru 
schools. It is an exceedingly valual 
contribution to a much needed phase 
the problems of rural education. 

H. L. TURNER 

Vichiagan State Normal Colleae 


Crreron, Epwarp DUNLAP, JA 
W. The C-D Machine Correlation Cha 
New York: The Macmillan Compan 
February, 1932. Twenty-five chart 
padded, 10% x 1654 inches, for $1.0 
The latest addition to the growing fan 


ily of correlation charts contains a desi 
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# ae but he neglects to diseuss how one may 
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improve teaching by a testing progran 
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number, 23 x 23 of plotting compart 
ts in a plotting space approximately 
Its chief 


t over its dozen or more progenitors 


claim to 


hes square, 
the use of alternate diagonal rows 
red compartments for facilitating 


iting of diagonal 


frequenci 8. 
off 


according to the method 


< advantage, however, is largely 

the need, 

ed, of counting diagonal frequen 
s twice, the astigmatism-producing 
eney of the checkerboard pattern in 
Its appellation of ‘‘machine’’ 
about by reason of the 


is made for record 
that th: 


directions for mak 


iat no provision 


and-made extensions and 


n sheet gives 
the extensions on the caleulating ma 

Only a portion of the formula 
ved are in most convenient form for 


And, 


according to the authors, the 


iting machine computation. 


rt ‘‘provides checks on all the in 
tant arithmetical work’’ no hints are 


as to the method of 


the 
the 
most experienced computer. 
will find the 
ns difficult if not impossible to 
llow With fold the 

nveniently in an 8% x 11 file folder. 
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locating 


rs whieh are inevitable even in 


se of the 


lovitiate abbreviated 


one charts will 
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\LEXANDER, CARTER. 
New 


Columbia 


Educational Fi 
York: 


University, 


ce Studies. Teachers 


1931. 


This work is devoted to a deseription 
nineteen recently printed dissertations 


| ene hers College. 


In the foreword, the 
ithor makes the following statement: 
‘No attempt is made to summarize a 
that any administrator inter 
n its special problem will not need 
read the original. The treatment here 
ms to help him ascertain when he needs 
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to read the original. 


yvreatest 


Possibly this 
such a 


is the 


service volume could 


dissertations are deseribed undet 


the following 


three headings l 
Procedures 


f Importance in Educational 


Finance, (2) School Costs, and }) State 


Aid for Schools, five of the dissertation 
oming in the first division, five the 


second, and nine in the Frankly, 


the 


third. 


reviewer can see little professional 


value in the volume Of the nineteen de 


scriptions offered, only a few are ade 


quate enough to achieve the 


purpose 


stated in the foreword. Some of the di 


scriptions would serve well as re 


very 


views for some magazines, and all of 


them would make exeellent « ps for a 


sales promotion program for the 


that 


disse 
this 
review may have an illustration of what 


hook 


tations. In order the reader of 


has been done, the last page of 
presented here: 
CAPITAL OUTLAY IS 


RELATION O A STATI 


MINIMUM PROGRAM 


The Problem 
‘*To find a technique which will enable 
a state to equalize the burden for eapital 


outlay purposes’? for public schools. 
Sourees of Data 
New Jersey state statistics for 1919 to 
1928 and the literature of the subject 


furnished the data. 


Methods Employed 
Highly statistical methods were em 
ployed, but the chief results ean he fol 
lowed by any interested schoolman. 


Important Findings and Reecom 
mendations 

1. A technique which will enable any 
state to equalize the burden for capital 
outlay for schools, through the relation 
ship of debt service to current expense. 

2. The best available discussion of the 
wisdom of so equalizing such outlays. 


Evaluation 


1. No state ought to enter upon state 
aid for school buildings, or to expand or 
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reorganize its system of such aid, without 
of Dr. Grossnickle’s findings and 
recommendations 

2 On this educational leaders 
and others interested in state aid for rural 
schools should have the book. 


mastery 


basis, 


By Foster E. Grossnickle, Ph.D. 
Teachers College, Columbia University, 
Contributions to Edueation, No. 464, 
1931 


The volume does not reflect the high 


quality of work which has usually come 


from the pen of Carter Alexander. 
Joun Guy FOwLKES 
University of Wisconsin 
EBAvGH, CAMERON DUNCAN. The Na 
tional System of Education in Merico 


Baltimore: The Johns Hopkins Press 
The Johns Hopkins University Studies 
in Education, No. 16, 1931. ix+-149 pp. 
The major part of this study is devoted 


to a deseription and evaluation of the 


national system of education in Mexico 
since the ‘‘reform of 1921.’’ Intro 
duetory to the major diseussior. the an 
thor considers briefly the geographical 
and social conditions of Mexico, recalls 


certain facets of Mexiean history, and de 
scribes educational conditions prior to the 
The 


deeade 


under special consideration. 


descriptive data in the main discussion 
are drawn largely from publications of 
the Secretariat of Education. Separate 


chapters are devoted to the department 
of rural schools, the primary and normal 
department, federal secondary schools, the 
National University of Mexico, the de- 
partment of fine arts, the department of 
psychopedagogy and hygiene, the depart- 
ment of school libraries, and ‘‘ other ac- 


of the Federal 
Education The two concluding chap- 


tivities Department of 


ters are devoted to a ** synthesis’ and 


‘econclusions,’’ respectively. 
The book contains a great deal of in- 
formation which educators in this country 


should know. There is no doubt that pro- 
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found social changes are under way so 
the Rio 
other social experimentation is being « 
scale. It 


of Grande. Educational 


ducted on a gigantie is chk 
too, that we have much to learn from t 
experimentation—not simply by way 
understanding and appreciating a nei; 
boring but by way of adding 
of the 
as a means for advancing social welf: 

If Dr. Ebaug 


and 


people, 


our knowledge educative 
h’s recital of facts on t 
of the feds 


government in Mexico is supplemented 


purposes activities 


other sources which will supply deta 
and incidents, the reader is sure to 
fired with admiration and enthusias 
Take the village school as an exam; 
and reflect on the intimate relation 


the school to the life of the communi 


Perhaps the very building has been bu 
not by the cold method of a bond iss 
but by the personal labor of the men 


the village. Or consider the cultural 1 


sion as it moves into a community w 


its various specialists, and see how 


teaching grows directly out of the « 


munity life. Problems of hygiene, ho 


ing, industry, and farming are not fou 


in a textbook based on ‘‘ real-life’’ sit 


ations; they come from actual grappl 
at hand. Wh 
others are busy with their specialitic 
the of 


those who can play this or that to fort 


with eonditions near 


teacher musie gathers toget! 
community orchestra or band. 
the 


great progress already made, one is k 


Without discounting in 


with the feeling that the book is, in mar 


respects, a description of aims and pla 
rather than accomplishment. The deseri 
tion would have been strengthened en 
mously by a first-hand survey of con 
tions and a detailed account of ty; 
cal situations. 

The evaluation, too, does not seem ce 


vincing. The method seems largely th 


least tl! 
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REVIEWS 


ef appeal to the writings of Kandel, tion of a test technique for presenting the 


Dewey, and others, with an attempt items: and, third, the determination « f 
w that the svsten conforms to the the optimum number of items to be in 
ples expressed by these educators eluded in a test which is to be admin 
praise Is So lavish as to leave the istered in a given length of time 
t 
exsion that the author has probably Experimenters in the past have quite 
| een as critical as he might have bee venerally neglected the problen or aa 
: wever, WU making available in ministration time of a test The author 
sh an account of the organization conducts an experiment showing that the 
plans of the national svstem of edu workin time allowed pupils i the a 
in Mexico, Dr. Ehaugh has made a ministratior test 18 rtant 
ble contribution to educational liter ‘actor in the validity of that test He 
. } re The hook should tM widelw re a the establishes what he terms the opt 
| testing time Tor ¢ el f his Six 8 
f Te ras ad ste pel ests 
Phe uthor was ver lic s in se 
is 
leeti the field of 8 lin where results 
W. W. The M ement of G ili 
easured objective 1 whe 
certain experi tation relative ft thie 
{ olled Comparisons Betwee Tecl 
lifficulty of items has already bee 
University of Towa, Studies i 
ned on Some of the eriticisms whi 
ation, VI, No. 6 February 1», 
pert nent te spelling tests 1 alsa le 
pplicable to other fields, such as, s 
I e eonstruetion of standardized and ; 
elenee Unfortunately, we re nal 
N standardized tests has ssumed a 
vet ti the res ilts f experimeé 
f increasing ti il educ 
tion ft the soein] science held in the sa 
‘ eireles the ist decade. I 
wav as in the field pelling t! 
growing field ft is ikely that 
‘ this « tribut verv wort 
1 stionabl pr eedures for test construc 
tion tie hits ‘ f test evalu 
and evaluation will find a ready a 
ation and test construction The impl 
tance because the makers of tests 
eations of the study should he given care 
n her have insufficient knowledge o1 fail 
bv those vho ire 
at to assume a critical attitude 
) tempting to construct and evaluate tests 
na recent experiment il study by 
k, certain roblems of test construc 
fricona State Teachers College 
have been given consideration. \ 
t satisfactory theoretical discussion of Morrison, HENRY ¢ The Management 
le ; e need for a eritical evaluation of pro of the School Money. Chieago: The 
at dures in the «ke velopment of te sting Universit, of Chieago Press, 
s echniques and experiments 18 presented, pp. XX 522 
rl his theoretical discussion 1s followed hy The author is well known in the field « 
a ; very adequate and comprehensive series public school finance and needs no intro 
ne f experiments measuring the results of duction His views on matters of econ 
vy { pelling. The study deals with three omy in the administration of the schools 
: ajor problems: first. the selection of have been pul lished in preceding v ] 
“4 est items with regard to difficulty and umes, The appearance of this book, 
hat @ seriminating power: second, the sele« which goes deeper into the details of the 
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practical realization f these ideas, was 
not ted 
Most W read the book wil 
the feelir that the titl 
t do justice t ts score Public 
sel ] sines management is vitally 
neerned with the whole range of edue: 
t il planning and is so treated in this 
book 
The author leaves mon for doubt 
concerning his sti preference for re 
iS, Dott pit land econtings ney 
He admits that there exists wide differ 
ences In opinion concerning the desirabil 
reserve fund ut presents arg 
ents ft t the tior ha 
tak It rtain that his proposals o1 
sitior t who ntain that 
XI t es e funds in the 
past has 1 the is t desirabl 
The ents ti 
t f the sition sup} od i 
] tis here its 1 
ePcveasitate lh ling ip reserve funds 
‘ ‘ nits | lhinol rror for the 
tes that the payv-Aas ul 
lies financin school buildings 
ent he ad pote 1 in ever the 
small « nities and maintains that it 
is the nly sound poliey from a financial 


tandpoint 

In accounting the budgetary 
he would not tolerate looseness or neglect. 
On this proposal, he will have almost 
unanimous support However, one must 
feel regret over his failure to reeognize 
the virtues of the Uniform School Ae 
counting Svstem adopted a few vears ago 


National Publie 


School Business Officials and which has 


hy the Association of 


been increasingly 


United States 


employed in the 


One striking feature of the work is the 


EDUt 


matters, 


{TIONAL RESEARCH [ Vol. 26, \ 
definition of terms used and the 1 
illustrations of eorreet incor 
sage Anv successful effort to cla 
pts and secure better usuge of te 
in this field is to he commended 
One of the chapters presents a vers 
quate treatment of terminal costs, a 


ject on which too much has not 


cept of terminal costs, thei: place in | 
hess nanagement of the schools, 
methods of computation. This is ] 
ablv the most comy 


of term nal eosts as applied to pul 


school finance and s, therefore, to be 
sidered listinet ntributior 

Several formula esented wl 
have not previously received wide pul 
ity These in le such matters as 
justed depreciati f buildings, build 
reserve requ red y) eount of ine? 
enrollment nad hen to sell ar ld} 

n nd site and n elsewhere Seve 
new ter eed conspr 

f whiel efficient of 
ect ‘ ‘ tor w t ~ heen kr wr 
IM entag f tilization.’ 

\ great deal of attention is giver 
the « lat on wil h t 
publie school syst rests. The thesis 
that sel Is 1 at t n to the econ 
fahy f societ mount equal to the 
cost or thev cannot eontinue to exist. | 
helieves that our schools meet this 


nirement and cites instances of how it 
done. He further believes that there st 
exists a great deal of waste and inefl 
whieh ean be largely eliminat: 


by a high type of professional educativ 


for the publie school administrator. 
This book may well be taken as a vah 
able addition to the new but growing fiel 
of publications primarily coneerned wit 
a more desirable type of administratio 
of the business affairs of our publi 
Gartu H. AKRIDGE 


Columbia University 


schools. 
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OT OT OF OF OR OE DE OROROR 


rka 


hmetie, 


ADMINISTRATION AND 
SUPERVISION 


¢ 


Schools,’’ School 


ontests 


‘* Inter sehoc 


American High 


XL (June, 1932), pp. 429-441. 
questionnaire study of imter 
tests in American igh sehools 


thor eoneludes that an extensive 
interschool contests are earned 
t lly all these types of 
ive devel n the 
S lua ng the past quarter of 
I isW Turnover Among 
> 1 Teachers in Illinois The 
er XI Tune, 1952 pp 
f turnover among eh-sel 
Illinois ra ten 
mit 
ST NES OF LEAI \ ) 
TEACHING 


HERBERT L 
the 


ehnique for 


Relationship between 


ning 


Preference and Perform 


rted 


Journal of Appl ed Psycholoay. 


VI (June, 1932), pp. 288 297 
m the use of two tests of twenty- 
problems, each on the subject of 


564 seventh. 


h, and ninth grade pupils that con 


administered to 


es that reported preference within a 


ww field ean he measured with a re 


ble degree of nce uracy by employ 


ing lt ‘ et] n na 
We Wi sit \ 
‘ elat m was tT ee! 
erences il pert nee 
BURKERSROD 
‘ Die Les 
er Gross ! ler Kleinsehreibur 


XIX (1932), pp. 1 

Legil lit I i tals and small letters 

ith S} ny esult in her 

eX] nts has roved that spelling 
wit nital letters is s r ir 

ilit BE. P. Aj t, Us sitv of Wis 


| nided Beli School a | 
AY 14. 1932 pp. 680 
Ont 
hyect this invest ition wis 
ld 
ate whether knowledge and attitud it! 


regard to unfounded beliefs, may 


changed by special instruction. The mean 


vain in achievement seore in desirall 


sponses following the instruction was 
percent, 

Prank N. ‘*‘An t 
in the Use of Typewriters in the 
Elementary 


FREEMAN, experimen 


School.,’’ School 


XXXII 


mentary 


Journal, June. 1932 


752-759. 
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or nh ent study of the ise 
ters nm tiv ele entar school 
‘ loes not eter ratio 
er the speed or the quality of han 
ting nil the ental irr 
8 t n tw ichievement 
ne 4 the rat vear 
Rex | Factors Conditioning 
elen ! Mot Skill lo 
ume | lf 
ment { r of punishment 
! unit tt esul f the 
t Significant f tors in ti ‘ 
nof skillful t rhe author found 
t attention on the idk f suecess, pun 
ent nl gross rs ttentior 
the ittention to mpan 
nsations were factors of doubtful 
ed low \ Forgettin ne 
Disuse. choloag cal he 
YNNIN luly, 1932 Py 
Evidence is presented to show that the 
«iisuse loes net account for for 
tting I'he vpothesis is advanced that 
necessalr conditions for forgetting 
nterp lated = saetin ties and altered 
lat n eondit ns Disuse is) Im 
rtant only in that it eo « ften gives the 
mary conditions an opportunity to aet. 
L. (., AND Moore, W. 
Growtl oft Mathematical Voeabulary 
fror the Third Grade Through High 
School,’’ School Review June, 
pp. 449-454. 


authors eonelude that inadequate 
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musterv of fundamental terminolog 
one of the most important reasons for ' 
difficulty encountered by so many 


if all ages and social strata in di 


with anvthing of at 


M ‘*Children’s Mis 
the Svmbols 
Mathematical Equality,’’ British Ji 


aloe Educational Psycholoa 

ine, Pi 73 ISS 

From a study of children’s miseor 
t ns concerning the svmbols for mat 
atieal equality the autho coneludes t 
there are manv ten to twelve vear old 


ren who find un 


prevents the 


eal expressi 
rHISTED, M N.. ND REMMERS, H 


The Effeet of Ter poral Set on Le 


alo lyppled Ps icholo 


Fron an experiments] study 


effeet of three different time sets or 1 
learning of 404 students of element: j 
psvelology the autl concludes that t 
data tend to establish a somewhat slov : 
drop in the forgetting eure when + te } 
poral set is introduced 
TINKer, Mites A. ‘*The Relation 
Spee! to Comprehension in Reading 


School and Society, XXXVI July 

1952), pp. 158-160 

From a review of previous investig 
tions re lating to speed and comprehensi: 
in reading, the author coneludes that 
there is a close relationship bet ween Spee 


and comprehension. 


per. 
68 
4 
thematica! nat 
_i 
that one numerical ¢ xp 
another rhis appears 
fact that heir eurly ft 
metie lends them to lool 
of eperation as an imy 
al 
XVI (June, 19 57-268 
| 
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ULUM RESEARCH girls between 12 and 13. Bovs between 


** Difficulties 13 and 14 take greater interest in ge 
wuntered bv High-School Gradu graphical books than girls, Their next 
sur the Use of Verbs,’’ School Re selection is books dealing witl ni 

XL (June, 1952), pp. 455-459 sciences, After the age 


history i8 inereased both bw bhovs an 


WALTER SCRIBNER 


of 15 interest for 


m an analysis of the test papers of 
virls Wishes for particular books are 
vh-sehool graduates who were given 
stimulated in the greatest number of cases 
Guiler-Henry Preliminary Diagnosti 
by ol mates *arents reat 
n Grammatical Usage the author 
influence Books were favorably erit 
s un analysis of difficulties eneoun 
cize| when the reader ] subieect 
high-school graduates in the use 
} matter, the eharacters and their fates, 
the dominating mood or seme isolated 
facet, (2) language and stvk binding 
Wintiam A. ‘‘Overlapping of 
and illustrations, when thy ook 
} ntent in Textbooks in General Sei , 
f . some relation to their own experiences 
e and Biology,’’ School Science and 
Pha mnvestiyation comes to the eon is 
fat Chibiren ecinning a The uge 
H05-61 
ire able to vige their readings in regwar 
ithor presents a statistical analy to content and presentation. A. Aj 
the e f eertai xthooks 1 
e eontent of certain text ks in pelt, University of Wiseonsin 
eral science and biology. The author 
s that over thirtv-seven percent of the 
Wees, Hanon A ‘*The High Sel 
| material in general seience is r Science Librarv for 1931 ; Peabod 
n biology, and fifty-six percent of ! | of Education, X (July, 1932 
: terials in biology is given in gen pp. 20-22 
- 
science He concludes that over 
The « hor presents i this rticle his 
ng es not nec asarily eonstitute a phe autho presen nm thi t i 
‘ e 4 innual list of newest books in the field.of 
ste ime 
nior and senior high-school seienes 
n Buchwunsel des jugendlic el \ 
Leser, Padaaoa sch sucholoadisch: 
tybeiten aus dem Institut des Lei} Courtis, S, A ‘*‘Criteria for Determit 


Lehrervereins, XIX (1952), py ng Equality of Groups, School « 
91-54 June 25, 1032). 7 


4 
Observations concerning selection ot 874-878 

ks of juvenile readers. The main goal The author discusses the inadequaey of 

the investigation was to find out what irrent methods of equating groups, and 

evelopment the literary interests ot suggests that matching must be based 

\ ldren who frequent libraries takes upon achievement and growtl He offers 

Children between 9 and 10 vears ask for five criteria for the equating of groups it 


eture hooks After this age they select school «¢ xperimentation, 
Fryer, Dovetas. ‘* Validating Measures 
of Interest: With Particular Refer 


j irv tales, legends, fables, funny stories, 
/ n the order given Adventure stories are 


4 wanted by boys between 11 and 15, by 
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Interest Scales,’? The 
/ hi XI August, 1952 
\ et ls of validat 
“4 \] t sh 1930,"" 
ay 
85-257 
resen nes ‘ 
feate n thei ppli 
t 19 Bibl | 
ous 
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‘ kopiseh 
oh Fatigue t gh the use 
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»-} cholo h frbeiten 


as 
‘ sing Petos 
a se res n stereopti 
fatigue wT ter 1f spec 
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AD t. Uni sity f Wisconsin) 
Guy Tit ‘Summar of 
\ Tr at 19231] ed 
School J XXXII 
66-77 
\r of investi 
rit] 
19°71 
} (uss uss fur Rega 
rsuntersuchungen: Vergleichende 
Begubungsuntersuchung an Haupt— 
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tee for the investigation of the ability 


i of children. Comparative study of the 
ve) bility of pupils in elasses for normal 
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Mary W. Blackstone Stenograph 

Proficiency Tests (Forms A and B 

Yonkers-on Ison, New York: Worl 

Book Company, 10232 

\ test to measure several essenti: 
abilities, consisting of: English, sy! 
labifieation, office practice, alphabetizing 
abbreviations, business organization, an 


transeription. 
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pul Is and classes for sub-nor 
children Padagqoaisch-Psycholoa 
lrbeiten aus dem Institut des Lei) 
Lehrervereins, XVIII 1930), pp. 7 
| 
\ppelt, | 
\\ , Paut A., AND LEHMAN, Ha 
** A Study f Voentional Attit 
and Intelligence,’’ The Elem 
XX XI (June, 19 
pp. 735-746 } 
Ky ym nr annlveis of the results 
tro the Li man \ eational Attit 
Quiz and the National Intelligence Tes j 
aus dem Institut des Leipziger Lehrer- ) 
Volume NVIIL (1930), pp. 
indiseriminately, 
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the Social Studics Investiga The tentative titles f the va 
Investigation of the So ports ( 
t Sore t he le r of t t 
Hist Associat Wi thers llows 
fs resnlts f sey ¢ he Ne Seis 
s throug! the press of hoc ( ‘ \. Rear r] ¢ 
Sons The first part sity 
t. entith 1 Charte oO ti So Chant oO he H j 
Schools, drafted | ‘ he Ne He 
\. Beard, and the second volume Johns ( ! i I ers 
So Chapte oO the Histo Citize 0 l the ¢ 
] e So Studies, of Youth, Bessie I se Pierce 
J . re available The third University of Chieag 
' Bessie L. Pierce, is entitled The P {pproach to the t 
} tions he Civi i of Societ L. Kelle 
Youth ind was expected Ha 1 Universit aA. Krev, Un 
t press dur the summet ve ity f Minnesot 
Meanwhile, work on the testi: pro ‘ Geo 
eing rounded out by Truman L Sciene Is Ame 
t estigation of the ge Geographic Society of New York 
element by Isainh Bowman in : KE ducatio Indust l Ge 
entitled The S ce of Geoaraphy Ss ( ints Col j | ersit il 
j Noy Studie he complete (Charles A. | ird 
» studies sl ild be ready for tl 0 ‘ of Co f fhe Sow 
fall Ernest Horn and R. M Si P ’ R M. Try U1 
devoting the major portion of versity f 
present to nleting the Vethods « Inst Soc 
t sand org tion of eo S rnest Hor U1 rsity 
ely T e studies will lown 
time next vear more ( c 7 h d Stat 
} t eation of objectives to the prob- Charles E. Merriam, University 
s of society is being prepared by Chicag 
rles A. Beard and George 8S. Counts. School Administration and Social S 
: will be ready for the press some time ence Teaching, Jesse H. Newlon, Colum 
toward the end of this vear. Othe bia University. 
j studies of various aspects of the problem T hie Selection and Training of the 
3 been arranged for, and the final re Teacher, William C, Bagley, Columbia 
‘3 rt of conclusions will be published in University, and Guy Stanton Ford, Uni 
December, 1933. versity of Minnesota. 
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Freedom of Teaching in the Schoo 
ird K. Beale, formerly at Bowd 
Social Ideas of A ican Educato 
e Curti, Smith College 
he dations o fj (ommissto 
il it f this, the final volun 
the ser s planned for Decemb 
/ aor th \ Oo conda 
fucatio ne lreal na ttt 
n enders ned friends heard the m 
t rs \ iN sat a inner in Was 
ton, D. ( June 9) marking th 
leet f the ft r untion-w 
ore ‘ nyress re re'se 
tf tw \ ! ‘ wath i 
itl il i the Nationa 
(\ssociation Sponsore 
nquet, and the Fy al Ofties 
ti Significant findings of tl 
\ erned wit llment 
‘ ~ 1 t ents 
st tive eorganizatior ane br 
et n2 nquirvy forms ar 
‘ v ten ers, 1 | Is | irents ine 
s, nnd from visits t more thar 
lifferent high schools in practicall: 
teats 
The present ortion of enrollment ip 
an high schools has never be 
led at \ ther period ro i? 
‘ ntry eh indienates that ra 
nereasing numbers of children fron 
we no evels are being giver 
pportunities of education at the se« 
lary level. Enrollment hav 
n from 4 pereent of bovs and girls of 
school age in 1890 to approximately 
nereent to-day 
ertain projects of the survev reveal 
espread tendencies toward change i 
eurrieulur f the schools. One study 


in 


ITIONAL 


shows an in 


ferent 


RESE 


courses offered 


{ROH 


‘reuse in t number of 


in the same g 


of schools for two periods about twe 


language ar 
trnunes requi 


subjeets mane 


classified h 
a deeline in 
matics tro 
taker n IS! 
For iil of} 

portion in tl 


i similar 


of from 55 to 3506 I 
fts in subjects required 
ave been awav from for 
athen atics college 


red subjects) toward s 


se] n the East re 
foreig! language and mat 

1.6 pereent of all w 
to 58.6 pereent in 19 
school in the West, the 
es ibjeets declined 


percent jects 
cluding the tf rts, practieal arts 
physical ed ition ive shown at 
crense In inv schools nonacadce 
subjeets now fron third tot 
fifths of all the pupil’s time in the ek 

Procedures ¢ rnaete ed bv the ur 
isSsigvnment ire ng the most treque 
| visions for ividual differen¢ 
Many pe icetices nm mader differ: 
classifications such as the Dalton, \ 


to deviate widely from those charact: 
istics of plans deser hed by their or 
nators. while manv others are essential 
identical in fort \ significant imy 
eation in this connection is that termin 
ogy is needlessly elal orate and compl 
and that the edueational world will 
hetter off if it diseards a great deal 
this yargo. 

Size for size, up to enrollments 
about 1,600, the six-vear school has a 
vantages over! the separate three-vea 
junior and senior high schools. Size 
enrollment is more important faetor ot 
difference between schools than type 


organization 


college movement Seems to demand that 


1 other plans are sa 


The vitality of the juni 


edueation 0 
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new unit be given a prominent place 
sehool system. 
formation from 400 schools and find 
f a specialist who traveled mor: 
00 miles to study facts first hand 
that the high sehool library will 
eeome one of the eentral features 
dern secondary school, Reports 
irnished also for this study by 


ls, revealing that the propor 


pupils making some use of tl 
y in schools operating a cor bined 
f library and study hall is mon 

tTwiee aS large aS in n whiel 


gy other si nificant findings are i! 
sing ! imbet of trade schools, fewe 
mmercial h oh schools, «e 

ise of correspondencs 


ssion to colleges and universities, andl 


vy for Negro se 


It is essential for school officers m or 
te to know the nature and direction o 
sress n the schools of other states 

formation 1s provided in the sur 


findings, to be ineorporated in twenty 


t different monographs, which it is 


would have taken one man from fitt 
xt ears to gather if he had beer 
@ me. Several of these volumes 


ivailable this fall. 

rte Nchool Finance Committe 

ad Committees con posed ot lead 
itizens in each state have been named 


vork with the National Survey 


Finance. These committees were 


by state supe rintendents an 
ssioners of edueation, and ineluds 
legislators and officers, school of 
university professors, and other 
ninent citizens Problems of finan 


the schools have brought demands fo 
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information which will throw light ! 
special questions confronting each state 
For this reason, it has heer deemed ad 
visable by the survey's board f 
sultants and authorities in finance, ed 
eation, and research to invite participa 
tion bw state ‘*eontact’’ groups La 
ers selected in each state will be infor i 
of the sress and Ivanee fit us 
the nation-wicte school-expet litur st 
and will be asked for advices time t 
time | the survey researc staff 
state ttee will meet | 
niissione f Edueati Coop direct 
if the survey Paul R. Mort, associat 
direetor Feder funds f this surve 
were provided until last Ju l Funds 
from private uspices will support ? 
tinuation f tl vork It is expected t t 
studv of the ma r project t state it 
schools will be far enough advanced 1 
per state committees ft worl wit 
state legislatures next sessiot Names 
eommitter en apy nted ln ‘ 
fror the I S. Offie f Ed t 
Washington, D. | 

Yearbooks of Departments of ti 
\ Yeart ks tentative 
ed s follows 

ay art ent ; } entary ~ 7 
Prineipals—The Elementary Pr 
cipal ar the L iries, 10 

Department of Superintendence 

tior Leadershit md 
Administration, 1954 

Dey artment of Classroon Teaches 
Characte 1932 i 1 
Teacher and the P e Relations of t 
Sehoo 10 

fet ti ( Vearbool T 
original committee in charge of this vea 
book of the Nationa! Societ for th 
Study of Edueation was under the cha 
manship of Frederick G. Bonser who died 


} 
i 
i | 
‘ 
} 
easing pportum + 
‘ ednueatior tiv t States 
t 
an 
a 
vil 
: 
J 
~ 
4 
: 


wy 
pry 
Septe 
st 
Ad 
imssr 


1, 1932 


Inistrative 


om 


Te her 


OULRNAL OF 
eadershiy t 
eeting, whi 
rol ] 
‘ I s Coffe 
iy ted t following 
ol 
t k mittes 
tt I M. Sipple, wl 
the P Ss n Balt 
ving people 
sit cag 
sit i: Suy 
Itzer Houst 
af nf? | ‘ 
Eng Raleig Nort! 
le] ‘ Aver, Milwaul 
{ Wi in H Ki 
n Lois C 
el rn | hers ¢ 
Pharm Stud 
phed bulletin Seve en 
| \\ | ters 
niversit | f the 
aT t t. B 
( ‘ 
The 
fiv-thres lleg f phar 
sfaction with the uss 
e the report 
ent ont 
tter odd 
i | 
t tv an 
Research Division of the 
ition Association which 


January ] 19852 


include the fol 


Practices A ffect 
Parts 1 and 2,’’ 
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t the selection by tment 
teachers. Part IL considers their r 

Est “Stat, ] 


eS past st S ar presents 
ravtive t espe Tt the 
=f tlie states n ? 
~ 
stat Sel Leg 19 
Fducatio id 
No. 10, February, 1932. This 
( ! summar f the major 
ects f 1931 sx Ol legislatior 
The Corporation TIneome Tax 
Its Relation to School Revenue Syste 
Stud State Educatia l Ad 


studies of 


5. Teache Professic Oraa at 
is svilabus for colleges asses 
line roblems for furthe study 
f information 

| Resea Di sion has per 
i litor ] n eonsultative ips 
itl ‘ ird ft the lieat 


t Superint ‘ entitled ‘*«C 
| t was issued in Febr 
the Washingt eeting of ft 
D t nt It is a diseussion f ch 
t dueation as ai funetion of t 
seh 


2. The Eleventh Yearbook of the Tk 


partment of Elementary School Principals 


has as its subject ‘‘ The Principal an 


His Community.’’ It is a survey of 
school-ecommunity contacts and em 


phasizes the principal’s opportunity for 


loeal community leadership. 


74 
Se J, s, 19 Kesearch Bulletin, Vol. 10, Nos. 1 a 
| 
January and Mar 1952. Part I dk 
' 
Mossman, 
if enev,’ he ch BR f Vol 
ny leat as t No. 3, May, 1932. This bulletin s 
\l 
nsist 
\ 
Ernest Hor 
Is \ ( 
Mil 
ht, State Teacl 
a . Tes 
ion, No 11, september, This 
the third of a series 
i Five Yea ent practices in state t t 
\ meog 
te 
St 
| 
Res at lepartments of the National Edueati 
l. The Tenth Yearbook f the Depart 
D | 
| 
nd ber 
low es: 
| 
ng ( om 
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Yearbook of the De 
f Classr I leachers was 1s 
June with the tith The Class 
nd Ch ter Educatio1 
hundant llustra ns f 


cational 


= 
+ 


This is the first number of the 
lume of the Review which is 
by the American Educational 
Association lepartment of 


Research. 


Re h 


‘ i jperation with the De 
tment of Superintendence, has issued 
lars since January 1, 1932 
City Sel Expenditures 
r ir No. 1, Januarv, 1932. This 
rizes the returns § fron i 
ire sent n November 1 1931 
i tS eities replied 


) 1932. This summary of art 
elating to edueat hieh © a} 

the period from December 1, 1951 


Practice in Selection of 
hers in City Sehool Svsten 


renlar No. 4, April, 1932. This ei 


ar contains a city-hy-city tabulation of 
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certa ictices n the select n 
te hers 
é Trends i Citv F 
1932 Cire r N M 
1L9G2 This study tabulates t 
fro } t scl | svat f 
t I e cde y witl vets 
pose mes 
Se] ul and ¢ Curr t Ses 
Cor Last 510 | { 
itior N M 
1932 rhis t lation f total t eX 
pense and sé x per sed on 
inl statistics ted } | ite 
States Bureau of the Census 
7. ‘«Edueat Diseuss Lay M 
nes, June 1, 1932,’’ Cir N 7 
1932 S ticle nol 
ed tio ag ines ¢ ers tl 
from April 1 to June 1, 1952 
‘School Funds on Deposit: Prot 


tions and Interest Rates,’’ Circular 


Divis f Rese stics 
estal ed the Ten ee State D 

t 
Its | t 

Ni \ k Cit | ni 
ew D ny | 


f tl major functions t I I) 

s to compile the data f the 

nual statistical repor vl pub 

bv the state department of edueatior | 

connection with this phase of the work, 


the assistance of seh wl exeentives wil 


he invited in order to develoy a better 


means of pupil and cost accounting. 


t 
. 
> 
ng 
0] 
ry 
ti minal Kd at ati lation . 
ance and Business Adminis 
3 
s the subject of the April is eels 
‘Tests of Personalitv and Charae ae 
s the subject of the June issue of Sty oe 
ce, June, 1932. This ecireular outlines the es 
methods of protectin achoo) funds in 
S large cities NT 
Tennessee Divisio of Research 4 aa 
**Edueation Diseussed in Lav Maga 
93°. ( tlar No 
from Febru: 4 30 
Kdneation Mis re 
| tik Lav May Grnimth, assistant Mh Pearson was for 
( ‘ a statist » in the United St; 
Office of Education at Washinetor Or 
| 
j 
¢ 


(re 
hye 

is i 
bers 

i le 
nore 
‘ 

at 
ke 

‘ 


fhe «f 
fire? ener 
next 
lit 


is iven 


JOURN 


iL. OF 


Peabody College for Teachers 
iva ible its library to the mem 
e Division, which will be a val 
7 As soon as the Division has 
om if lata and facilities, it is 
with tl cooperation of gradu 
nts in residence at Peabody, to 
tuin studies which will assist 
fullfilling their thesis require 
it t me time be of benefit 
ite department of edueation. The 
‘ will he eoneerned with the 
raining stitutions of the state 
study ill deal with the financial 
if the county publie sehools 
ce Test Scotland.—Dnur 
eel ine 1932, a testing 
Wits rid out in the Seot 
Ix | the Seottish Couneil for 
in Mdueatior The survey econ 
fat telligence test applied to 
eleve vears f nee onl 
rin 102] It is intended t 
iriation in maturity 
ee, apart ind the dif 
i} if lren to benefit 
f which thev ar 
hi survey volves 90,000 
t! t Seotland ind only 
private sch ire not par 
f the results secured from the 
ts ‘ ti | portion of: 
lefecti ldren in Scotland, 
henefiting from se 
ed itor and children 
benetiti fror university 
st of the investigation will 
pounds Since Seottish 
ave not een aecustomed = to 
telligenee tests, a preliminary 
n consisting of eight questions 
The aetual test eonsisted of 
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seventy-one questions for which forty 


minutes were allowed 


Cooperative Test Ne Cr. 


The pur; 


of the C operative Test Serviee, 437 


ovth Street, New York City, under 
terms of the subvention fron the Gens 
nder the ausp 
of the Americar Couneil on Edueat 


iS to eonstruect ter or more eon par 
forms of examinations in the fu 
mental subjects of junior college 

senior high school levels, and to m: 


them available to the colleges and seho: 


ges and sehools mav inauy 


of these tests with the 


new parable forn 
mac ivailable each ve 
15. The advantages of t 
imber of forms, in terms 
lards fror vear to veat 
ve purposes, are bvious 
Re po tf of the Ca eaie Foundatia 


The twenty-sixth annual report of 1 


Carnegie Foundation for the Advar 
ment of Teaching covers the vear end 
June 30, 1931 The president of t 
Foundation is Henry Suzzallo In t 
past neteen vears the Foundation | 


‘ xpended more thar 21.098 000 studi 


relating to colleges and universities. It 


resources are S31.824.506 During t 
past twenty-six vears it has expended 
on retiring allowances and pensions f 
colleg and university professors m 
than $21,000,000 The report comment 


upon the Pennsylvania study of relation 
between high schools and colleges, leg 
education, and reorganization of colleg 


athleties 


General Educatio Board Projects 


The annual report of the General Eduea 


~ 7 


Ril 
4 
| 
one Torm ¢ t 
cost. Coll 
rate the use . 
ert ng the 
‘ tial a | 
Resen re 
ory 
ree 
Some 
mentally | 
education 
umount 
— 
i 
4 
j 


— 
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| for 1930-1931 ineludes an as 
projeets and sul 
especial interest to wi rkers in 
f educational researciu: a study 
ticulation between secondary schools 
es at the University of Buffalo, 


inde 


experimental use of an 
t study plas extended to the junior 
S20 
University of Chicago plan of 
$371,700; the 
S50 000: 


survey, 


es in conneetion with honors work at 


Holvoke College, involving enlarge 
1 rex struction of the library i 
tional appropriation of $375,000; 
College, a conditional grant of 

study ot the comprehensiy 
the Association ot 


Colleges, $25,000; a study of 


Associ 


a new edition of a Hand 


North Central 
Unive sities and Col 
the Ameriean Council on Edu 


ation of 


S,000; an mvesti 
nusual library items 

Li rary 


support if 


Association, 
divisions of infor 
Alabama, 
s, North Carolina, and West Virginia, 


n and Statistics mn 


livisions of schovolhouse planning and 
struetion in Oklahoma and Texas, 2 
te f 69.800: a new division of sehoo! 


aries in Alabama, $50,000, and of in 
ation and statistics in New Mexico, 
00; and special curriculum and ad 
nistration studies in Florida, Virginia, 
| Oklahoma, a total of $24,300. In ad 
o these studies and projects the 
d gave generous aid to holders of fel 
librarians in the 


wships, training of 


ith, and to Negro education. In many 
stances the grants are distributed ove: 


period of vears. 
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Way 
raphed 


Highe 
bulletin of the 


Studies Under 
tion. \ 


United States Office of 


mimeog 


date of March, 1952, is a partial list of 


investigations in progress dealing wit! 


student personnel, eolk riate 


and curriculums, improvement of methods 


f testir and administration 
‘ Bil ward) hu. \lime 
graphed bulletin No. 5, 1932, of the S 
ietv Tor ¢ rie hut Study ne ies 
references covering — the period from 


Mareh, 1951, to 


are Henry 


March, 132 The eon 
Harap of Western Re 


» State 


pilers 


serve and Edgar Dale of Ohi 


University 


Durham, North Car 


ces publication of at 


Press, 
ina, 
nal, Personalit \ Quarterly for 
Allied Studies, with the 
September, 1982. Th 


editor is Robert Saudek of London with 


an international collaborative staff rhe 
subseription price a $3.5 per ver 
Fields of interest of the new journal will 
be: the investigation of characterology, 
tvpology, the bio-physical basis of pet 
= lit experimental graphology, dif 
ferential and social psychology, psychia 


trv, psychoanalysis, family study, the 


study of heredity and of glands, experi 
mental behaviorism, criminology, in 
thropology, and comparative inimal 


psy chology. 


Nearo Education.—The 
new Journal of Nearo Education, pul 
lished by 
by C. 


tion, has devoted its seeond 


Yearbook on 


Howard University and edited 
Thompson of the same institu 


(July 


ber to { Critical Survey of the 


num 
Ve aro 


Elementary School. The topies treated 


are: financial support, administration 


‘ 
| 
Me 
d 
of | nder 
} 
Vew Jo al o Personalit Duke 
n, Beat! 
ces | 
¢ 
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! ontrol, pl il equipment, teaching 
staff visi student person ‘ 
hand pped hild, and 
graphy 
State G luate thstracts The 
‘ bstracts of theses ! 
‘ t t Penns ania State College 
les summat f thirty-two Masters’ 
tors’ studies Each abstract is 
t ges in length, wl permits cut 
t t int irds issifieation bv 
t ind filing in the Loyola Digest 
A at Stonehan 
VW The plas tiated by Supt. C. I 
Varne S rather ‘ ind ¢ npara 
t nexpe ‘ With his elementary 
ervis I ul, the ssist 
e) p ] l five te Tu 
‘ tered iss in arithmetic re 
at ler G. M. Wilson at Bos 
I t\ Weekly « ferences of 
é ranged \ locn 
rve f t tie usage | idults was 
} ttees of teachers were 
pr bile a } ic ft thie 
thmet lua The prineiple of 
ent results in tool processes was 
ivecepted, and final suecess seems alread 
ed Other prin les are eing set 
up, meaning’’ first in verbal 
| vork, elimination of socially use 
les esses, et The work no doubt 
will continue in intensive form through 
out ther vear The « fforts for hetter 


results in arithmetie are affecting favor 


ably work in other subjects 
National 
Ellwood P. Cubberley, 
of Edueation f 


Committee. Dr. 
Dean of the Schoo! 
Stanford University, 


reached the con pulsory age limit and r 


tired from active service at Stanford on 


June 6, 1933. A representative national 


committee is making plans for a suitable 


{TIONAL RESEARCH [ Vol. 26, \ 
commemoration of his thirty-five vea 
outstanding service to American ed 


tion as administrator, teacher, aut 


editor, and educational statesman 


and 


tures. A committee of experts appr 


Research in Silent Sound 
by the Commissioner of Education 
to eighth-grade bovs and girls fron 


] 


various states a preliminary examinat 
at Washington, D. C.. to aseertain t 
knowledge of a given group of subj 
On the 


three days following, educat 


sound pictures, prepared by the Fox F 
Corporation, covering the same gro 
subjects were shown the children. Fin 
they were given another set of exar 
determine how much the 
learned from the pictures seen and he 


The subjeets covered were voleanoes, 


ciers, rivers, toads, and Monarch butt 


flies The report shows that the | 
ind rls answered correetly, on an 
ive nineteer e questions out t fi 
n each test iffer seer the s 1! 1 


eational | tures thar they did het 
This is an ave race rai of as 
An earlier comparabl 
silent film and conducted by David 
1928, showed an ave 


Knowlton in 


gain of 19 percent. Therefore, a « 


parison of the two tests seems to ir 


sound twice 


pietures are 
effective in terms of gain as silent 
in educational work 

During the past two vears or more t 
Electrical Products, Ine., 
York City, also has sponsored a progra: 


of investigation in connection 


Research 


with t! 
production of educational sound pictur 
literature in the fie 
that tl 
effective use of many silent films in t! 
schoolroom is affected by the followir 
the pictures do n 
readily fit into or correlate with the cur 


A survey of the 


of visual education indicated 


limitations: (1) 


| 
de 
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| because teacher pupil needs and interest of the pupil and act as a stimu 13 
f study requirements were net for further activity 
1 in the preparation of materia Cireular No. 46. January, 1932. of the 


| eture: 2 the pictures otter United States Office of Education. pre 


te the teacher’s efforts and preset! t pared by J. O. Mal itt. p 


als which the teacher could obtair detail the status of motion pictures ii 
let: hy tu ures 
ther wavs; 3) many of the films nublie elementary and ndarv } ] 
. nublic eme d seeonda schools 
ttle or no educational value; and the te 
the eosts of equipment and pietures may } 
seleets sn es I rize 
ften prohibitive. 
I : thousand of the princely ils and superi 
n effort to overcome the deficiencies 
tendents i mmunitres f 2.500 or n 
silent films, a tentative set of ' a 
reported some use of films 501 co 
Is was set up to guide the pro nl ; 
f munities i percent ive visual-ed it 
1 of educational talking pictures 
lepartments, while 36 pereent secure the 


re that: 1) no sound should le 
metures through the efforts of individual 


} 1 which does not aid the pupil ‘ = 


. teachers in connection with their inst 
retineg the pieture before hin 
onal project Of 439 svster 
etic should be shown which does : 
' ve a significant meaning to th 
throuel t! rd f adueatior;r 
each scene should be as pi ; 
17 percent through revenues from enter 
perfeet as possible and include : 
nt ana chon 1° ner 
the elements associated with suel In 15 
in a life situation; t+) the cent of the communities ** Tree fil 


materials should be definitely ar 


lifferent levels of instruetior the svstems did not seeure ar of the 

ture should possess unity, eacl films from commercial sources Tw 
eing an integral part of the picture thirds secured more than one-half of their 

le: a the } eture must correlat hims tron edt itional eenters t\ 

t learnin experiences being ere state, federal, and university Other se 

v the school: 7 no materials tions of the report deal with the lengt 
be presented in the picture whic! of time the borrowed films are retained 
j teacher might otherwise obtain: (8 usually one day), uses of motion pictures 
aterials should he checked with most common in social sciences, natura 

tative sourees to determine their scienees, and physical edueation), o 
rnev: and (9) to be a real contr ectives achieved, diffieulties, and use of 

pictures must arouse and hold the teaching aids. 
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“A 
ber. ?] 
; 
Py: ne 
| 
al 


“in thie ‘ 
n eal tio 
wig t st 
‘ ning is 
nee ra tua 
t | ‘ peerte 
4 in experience 
x nt where ‘ nir 
This crit 
rou hye ‘ 
ills 
Ins 
ly This is 
‘ 
ete t 
nstructiona 
ur for heir wus« 
venr out rhe 
*% es the way 
n K Trom hiel 


d to tell the 


and the pro 


schools this es 


nstruction to hit the 


a studv ex process 8 not clear to him. For ir 


TESTS THAT AID PUPILS TO LEARN HOW TO LEARN 


Persians ce More than this, these tests call out 


ity to rice incentives of the pupils tor study. h 


one tends at once to advanes his pres ‘ 


th some ¢ 
hich a need experience so as to ime lude that whict 
is evident s to be learned 
at once the The following illustrates the type 
gin. 
S study situation set up by the Sang 
‘ I Reidy Tests in Arithmetic. When 
study of decimal fractions 1s taker 
enen 
ml incentive and the idea is presented that the ds 
t starts at mal point indicates the fractional 
self-directed 


of the number, and the number of di 


plished when 


US interest al places as a power of ten tent 
ual personal ex undredths, indicates the denominator 
arn in ordet of the fraction, then give the first test for 
experience this top The diftieulties of the idea 


of decimal fractions for some pupils 
found as each comes to a test exer 


cise in which the use of the de 


stance, a pupil divides .15 by 3 and 


s the answer, .05. But in the next 


et 


is of Verfect 


Percent Pupils Score 


NUMBER problem he does not understand how, in 


1\ V the process of dividing 24.6 by 4, to 


S580 

! SO-S4 

70-74 

H5-H0 


15-40 


handle the remainder of two-fourths of 


6 a tenth by changing 


the q iotient 6,1 
6 to 6.15. This change he is able to work 
} for himself when he recalls that .6 is also 


60 and that a quarter of 60 hundredths 


.15 

5 

1 The class record sheet for three ir 
2 - creasingly difficult tests on the use of 
decimal fractions is given at the left. 
bi The first test includes 15 types of diff 
. culty. The second 18 more difficult types 
~ and the third covers the most difficult 
é work. Note that by discovering wh 
- each pupil reached his limit on the first 


test and by holding all pupils to the 
neentive to learn why and how, all 
advance their attainment by nearly 
equal amounts. <A similar advance was 
made by all on the final test. Note that 


the lowest pupil made a higher seore on 


lotal No. of Pupils 
Tested 
Median Percent 
Correct 


35 35 the third and most difficult test than the 
best pupil had made on the first test. 


7.5 78.8 
(9 | 4 Every pupil learned how to learn. 


f PUBLIC SCHOOL PUBLISHING COMPANY 


Bloomington, Illinois 


a. 
4 
« 
0b 
the al 
ame 
| 
nt, 
rnit 
in Re 
n, W * 
si'y f 
extr 
net 
at 
TEST 
A 
()- 3 
10-44 
30-30 ‘ q 
30-34 
15-19 l 
lu-14 tig: 
5-9 
| 
35 
fre 
30.3 | 4 


